-- Logs begin at Thu 2022-10-06 03:52:30 UTC, end at Thu 2022-10-06 04:59:00 UTC. -- Oct 06 04:23:39.713809 dv-cinder-860227-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 04:23:39.722990 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 04:23:39 2022] *** Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: nodename: dv-cinder-860227-2-iscsi Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: machine: x86_64 Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: clock source: unix Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: pcre jit disabled Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: detected number of CPU cores: 4 Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: current working directory: / Oct 06 04:23:39.724872 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: detected binary path: /usr/bin/uwsgi-core Oct 06 04:23:39.725477 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: your processes number limit is 47680 Oct 06 04:23:39.725477 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: your memory page size is 4096 bytes Oct 06 04:23:39.725477 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: detected max file descriptor number: 2048 Oct 06 04:23:39.725477 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: lock engine: pthread robust mutexes Oct 06 04:23:39.725477 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: thunder lock: enabled Oct 06 04:23:39.725477 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 04:23:39.725477 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 04:23:39.764918 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: Python main interpreter initialized at 0x55c3edc279c0 Oct 06 04:23:39.764918 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: python threads support enabled Oct 06 04:23:39.764918 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: your server socket listen backlog is limited to 100 connections Oct 06 04:23:39.764918 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: your mercy for graceful operations on workers is 90 seconds Oct 06 04:23:39.765296 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 04:23:39.765296 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: *** Operational MODE: preforking *** Oct 06 04:23:39.765569 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: *** uWSGI is running in multiple interpreter mode *** Oct 06 04:23:39.765569 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: spawned uWSGI master process (pid: 105409) Oct 06 04:23:39.765763 dv-cinder-860227-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 06 04:23:39.767265 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: spawned uWSGI worker 1 (pid: 105410, cores: 1) Oct 06 04:23:39.767265 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: spawned uWSGI worker 2 (pid: 105411, cores: 1) Oct 06 04:23:39.767265 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 04:23:40.427037 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 04:23:40.449155 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 04:23:41.515527 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:23:41.515527 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: from cryptography.utils import int_from_bytes Oct 06 04:23:41.516225 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:23:41.516225 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: from cryptography.utils import int_from_bytes Oct 06 04:23:41.520997 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:23:41.520997 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: from cryptography.utils import int_from_bytes Oct 06 04:23:41.521434 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:23:41.521434 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: from cryptography.utils import int_from_bytes Oct 06 04:23:44.001342 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 04:23:44.002000 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 04:23:44.002147 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 04:23:44.002502 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 04:23:44.002695 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 04:23:44.003075 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 04:23:44.003176 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 04:23:44.003274 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.003471 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.003577 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 04:23:44.003791 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.003880 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 04:23:44.004094 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 04:23:44.004189 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.004422 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.004510 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.004732 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.004836 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.005047 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.005133 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.005364 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.005457 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.005689 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.005784 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.005949 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.006042 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.006261 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.006346 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.006583 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860227-2-iscsi {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.006677 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.006899 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.007014 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.007182 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.007274 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.007496 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.007591 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.007819 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860227-2-iscsi {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.007905 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.008117 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.008201 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.008423 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.008515 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.008730 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.008848 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.009037 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.009234 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.009349 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.010358 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.010504 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.010621 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.010717 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.010717 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.010930 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011099 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011232 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011316 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011450 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011534 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011619 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011752 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011835 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.011913 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.012049 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.012133 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.012234 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.012377 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.012549 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.012771 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860227-2-iscsi {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.012866 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.013087 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.013172 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.013397 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.013504 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.013706 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.013831 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860227-2-iscsi {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.014115 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.014203 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.014425 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.014512 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.014732 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.014832 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.015084 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.015263 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.015394 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.015480 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.015701 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.015799 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.016026 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.016155 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.016345 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.016434 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.016652 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.016745 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.016968 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.017054 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.017270 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.017858 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.018089 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.018191 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.018405 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.018499 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.018706 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.018875 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.019044 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.019133 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.019352 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.019438 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.019632 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.019736 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.019940 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.020037 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.020242 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.020329 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.020490 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.020590 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.020796 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.020891 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.021109 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.021196 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.021343 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.021437 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.021662 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.021751 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.021964 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.022059 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.022212 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.022307 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.022528 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.022615 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.022846 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.022943 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.023179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.023265 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.023483 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.023572 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.023786 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.023882 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.024092 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.024185 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.024392 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.024478 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.024697 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.024784 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.025003 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.025098 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.025308 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.025401 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.025611 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.025697 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.025921 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.026005 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.026240 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.026327 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.026545 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.026632 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.026849 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.026941 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.027209 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.027296 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.027506 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.027592 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.027810 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.027897 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.028123 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.028218 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.028442 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.028530 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.028742 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.028835 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.029047 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.029149 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.029352 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.029446 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.029654 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.029748 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.029956 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.030051 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.030258 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.030345 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.030504 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.030589 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.030801 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.030898 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.031124 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.031213 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.031431 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.031517 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.031727 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.031823 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.032024 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.032121 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.032323 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.032423 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.032619 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.032708 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.032916 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.033610 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.033786 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.033883 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.034091 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.034179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.034394 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.034480 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.034698 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.034784 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.035021 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.035126 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.035325 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.035413 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.035627 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.035722 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.035930 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.036018 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.036230 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.036314 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.036529 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.036620 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.036829 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.036917 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.037129 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.037214 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.037427 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.037522 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.037729 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.037817 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.038031 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.038117 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.038329 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.038424 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.038630 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.038717 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.038933 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.039079 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.039270 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.039356 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.039571 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.039658 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.039871 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.039955 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.040181 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.040278 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.040480 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.040566 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.040779 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.040865 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.041092 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.041188 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.041387 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.041514 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.041686 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.041779 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.041995 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.042090 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.042290 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.042377 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.042586 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.042672 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.042884 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.043069 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.043205 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.043293 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.043506 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.043600 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.043803 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.043899 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.044097 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.044183 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.044394 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.044487 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.044685 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.044778 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.044979 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.045110 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.045278 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.045373 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.045572 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.045670 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.045876 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.045971 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.046176 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.046264 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.046479 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.046566 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.046782 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.046867 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.047106 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.047209 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.047422 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:23:44.047510 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.047751 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.047846 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.048078 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.048183 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.048409 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.048497 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.048755 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.048858 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.049064 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.049205 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.049374 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.049495 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.049695 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.049814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.050004 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.050124 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.050310 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.050435 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.050618 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.050759 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.050933 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.051086 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.051268 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.051388 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.051595 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.051692 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.051907 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.052008 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.052219 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.052313 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.052532 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.052620 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.052840 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.052935 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.053156 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.053243 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.053478 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.053564 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.053795 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.053884 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.054099 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.054187 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.054426 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.054511 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.054745 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.054841 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.055078 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.055206 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.055408 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.055494 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.055723 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.055814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.056030 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.056117 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.056337 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.056434 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.056644 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.056732 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.056963 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.057049 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.057264 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.057359 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.057574 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.057661 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.057884 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.057971 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.058194 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.058290 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.058505 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.058591 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.058818 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.058904 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.059149 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.059284 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.059459 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.059547 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.059768 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.059862 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.060072 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.060159 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.060378 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.060472 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.060687 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.060786 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.060994 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.061083 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.061305 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.061398 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.061613 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.061739 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.061923 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.062012 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.062231 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.062318 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.062534 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.062621 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.062842 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.062930 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.063166 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.063256 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.063466 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.063563 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.063765 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.063854 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.064069 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.064158 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.064415 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.064511 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.064795 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.064974 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.065121 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.065293 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.065425 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.065593 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.065755 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.065901 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.066058 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.066225 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.066365 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.066530 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.066673 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.066858 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.066998 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.067188 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.067305 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.067496 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.067616 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.067805 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.067924 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.068114 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.068210 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.068417 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.068532 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.068728 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.068843 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.069035 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.069134 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.069338 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.069450 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.069660 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.069746 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.069966 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.070062 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.070269 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.070356 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.070588 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.070675 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.070890 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.071031 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.071247 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.071334 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.071556 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.071644 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.071874 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.071968 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.072180 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.072277 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.072486 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.072580 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.072792 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.072880 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.073114 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.073212 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.073415 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.073508 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.073720 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.073808 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.074042 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.074134 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.074353 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.074440 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.074650 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.074739 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.075027 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.075135 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.075306 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.075455 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.075570 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.075659 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.075867 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.075955 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.076171 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.076268 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.076468 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.076556 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.076766 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.076860 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.077063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.077161 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.077359 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.077446 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.077656 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.077742 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.077956 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.078052 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.078253 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.078341 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.078551 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.078661 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.078846 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.078935 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.079166 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.079253 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.079478 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.079564 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.079781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.080366 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.080724 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.080833 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.081053 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.081157 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.081372 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.081460 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.081683 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.081771 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.081994 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.082101 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.082305 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.082394 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.082611 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.082706 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.082919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.083040 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.083250 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.083337 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.083558 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.083645 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.083863 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.083958 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.084170 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.084271 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.084475 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.084568 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.084779 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.084881 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.085094 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.085180 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.085399 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.085536 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.085713 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.085809 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.086013 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.086108 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.086321 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.086416 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.086627 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.086714 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.086944 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.087076 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.087265 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.087352 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.087576 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.087672 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.087892 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.087978 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.088205 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.088291 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.088510 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.088606 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.088817 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.088904 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.089132 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.089218 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.089439 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.089568 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.089742 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.089839 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.090047 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.090141 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.090357 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.090444 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.090658 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.090758 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.090982 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.091083 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.091294 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.091381 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.091607 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.091693 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.091904 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.092038 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.092217 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.092305 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.092521 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.092608 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.092836 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.092937 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.093138 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.093245 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.093441 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.093534 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.093757 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.093852 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.094067 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.094152 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.094375 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.094461 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.094685 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.094775 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.095009 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.095098 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.095316 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.095404 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.095720 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.095819 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.096008 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.096106 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.096311 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.096407 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.096617 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.096714 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.096916 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.097002 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.097226 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.097312 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.097529 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.097624 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.097830 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.097925 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.098128 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.098225 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.098433 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.098526 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.098737 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.098822 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.099067 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.099170 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.099368 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.099455 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.099678 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.099765 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.099978 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.100073 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.100279 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.100367 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.100594 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.100680 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.100898 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.101040 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.101199 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.101287 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.101497 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.101582 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.101793 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.101894 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.102106 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.102201 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.102406 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.102493 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.102704 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.102800 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.103023 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.103114 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.103342 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.103428 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.103647 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.103736 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.103944 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.104039 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.104247 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.104333 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.104550 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.104647 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.104855 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.104940 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.105163 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.105249 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.105467 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.105562 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.105772 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.105875 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.106076 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.106225 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.106384 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.106481 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.106683 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.106769 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.107009 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.107112 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.107316 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.107403 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.107621 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.107707 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.107924 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.108019 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.108223 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.108317 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.108529 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.108616 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.108831 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.108926 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.109139 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.109394 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.109482 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.109725 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.109825 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.110035 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.110120 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.110609 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.110854 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.110943 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.111767 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.111974 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.112085 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.112334 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.112434 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.112660 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.112756 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.112973 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.113070 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.113278 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.113373 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.113586 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.113680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.113889 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.113985 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.114191 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.114278 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.114498 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.114585 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.114801 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.114897 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.115127 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.115232 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.115435 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.115521 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.115734 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.115877 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.116034 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.116122 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.116336 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.116437 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.116633 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.116730 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.116934 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.117020 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.117234 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.117321 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.117532 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.117627 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.117829 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.117916 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.118128 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.118222 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.118424 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.118511 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.118731 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.118819 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.119050 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.119141 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.119350 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.119441 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.119658 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.119747 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.119955 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.120067 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.120253 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.120342 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.120554 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.120649 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.120895 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.120992 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.121196 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.121284 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.121527 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.121621 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.121829 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.121935 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.122149 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.122245 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.122449 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.122536 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.122747 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.122845 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.123073 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.123164 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.123377 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.123465 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.123677 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.123766 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.123972 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.124058 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.124273 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.124366 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.124576 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.124670 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.124871 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.124966 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.125175 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.125262 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.125470 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.125559 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.125772 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.125866 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.126069 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.126164 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.126364 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.126452 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.126679 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.126789 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.127026 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.127141 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.127324 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.127413 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.127629 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.127717 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.127926 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.128022 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.128221 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.128315 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.128523 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.128620 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.128819 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.128918 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.129115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.129203 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.129414 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.129502 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.129712 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.129813 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.130006 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.130100 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.130309 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.130396 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.130610 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.130699 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.130904 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.131011 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.131244 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.131342 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.131548 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.131635 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.131845 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.131931 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.132141 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.132226 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.132444 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.132536 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.132744 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.132849 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.133039 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.133126 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.133340 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.133428 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.133637 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.133723 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.133937 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.134032 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.134241 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.134328 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.134543 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.134630 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.134845 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.134941 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.135169 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.135260 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.135469 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.135556 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.135766 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.135865 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.136062 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.136164 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.136356 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.136445 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.136651 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.136748 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.136946 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.137032 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.137243 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.137329 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.137540 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.137628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.137842 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.137929 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.138138 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.138224 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.138437 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.138532 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.138733 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.138821 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.139054 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.139145 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.139356 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.139453 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.139655 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.139744 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.139995 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.140137 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.140297 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.140390 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.140611 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.140705 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.140920 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.141016 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.141229 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.141316 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.141538 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.141631 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.141835 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.141931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.142141 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.142236 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.142975 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.143072 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.143285 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.143385 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.143583 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.143670 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.143883 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.143970 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.144190 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.144284 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.144489 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.144585 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.144791 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.144891 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.145109 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.145206 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.145464 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.145763 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.145850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.146072 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.146167 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.146378 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.146465 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.146684 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.146771 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.147020 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.147123 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.147324 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.147419 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.147626 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.147712 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.147932 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.148098 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.148239 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.148327 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.148543 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.148629 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.148844 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.148939 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.149149 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.149236 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.149450 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.149539 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.149755 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.149843 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.150063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.150149 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.150362 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.150457 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.150665 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.150753 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.151000 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.151102 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.151291 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.151377 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.151590 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.151677 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.151885 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.151971 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.152193 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.152284 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.152492 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.152579 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.152796 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.152910 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.153096 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.153219 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.153402 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.153527 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.153701 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.153827 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.154119 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.154216 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.154429 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.154516 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.154734 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.154829 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.155056 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.155160 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.155358 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.155446 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.155663 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.155769 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.155975 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.156071 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.156286 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.156374 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.156585 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.156673 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.156954 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.157041 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.157252 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.157351 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.157560 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.157647 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.157875 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.158001 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.158322 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.158454 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.158699 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.158796 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.158915 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.159082 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.159257 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.159406 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.159559 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.159709 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.159879 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.160012 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.160296 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.160383 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.160603 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.160701 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.160907 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.160994 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.161224 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.161311 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.161608 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.161708 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.161916 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.162003 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.162221 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.162315 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.162541 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.162728 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.162863 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.162984 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.163191 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.163293 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.163503 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.163591 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.163809 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.163909 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.164130 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.164218 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.164449 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.164535 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.164755 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.164851 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.165060 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.165147 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.165358 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.165444 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.165677 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.165767 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.165982 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.166075 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.166290 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.166376 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.166590 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.166678 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.166909 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.167055 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.167254 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.167343 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.167567 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.167657 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.167886 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.167973 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.168232 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.168319 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.168533 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.168621 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.168832 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.168920 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.169136 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.169238 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.169437 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.169525 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.169735 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.169824 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.170057 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.170154 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.170358 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.170445 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.170662 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.170758 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.170975 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.171126 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.171284 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.171379 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.171582 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.171670 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.171880 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.171976 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.172185 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.172309 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.172480 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.172567 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.172777 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.172871 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.173075 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.173200 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.173391 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.173479 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.174274 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.174500 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.174594 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.174676 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.174911 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.175024 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.175257 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.175348 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.175575 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.175662 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.175875 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.175969 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.176175 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.176263 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.176484 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.176571 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.176786 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.176882 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.177086 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.177174 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.177388 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.177475 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.177731 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.177828 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.178034 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.178129 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.178350 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.178438 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.178672 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.178772 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.179011 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.179103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.179320 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.179406 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.179633 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.179731 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.179956 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.180044 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.180258 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.180346 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.180564 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.180659 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.180869 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.180956 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.181171 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.181258 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.181470 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.181560 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.181769 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.181855 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.182070 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.182155 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.182369 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.182457 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.182666 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.182752 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.182975 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.183064 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.183297 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.183387 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.183597 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.183685 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.183894 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.183989 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.184193 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.184290 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.184497 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.184591 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.184824 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.184971 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.185101 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.185200 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.185411 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.185499 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.185713 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.185810 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.186014 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.186110 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.186313 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.186408 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.186635 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.186783 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.186924 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.187032 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.187271 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.187358 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.187584 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.187682 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.187897 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.188210 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.188296 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.188520 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.188618 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.188832 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.188919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.189136 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.189278 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.189502 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.189599 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.189816 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.189904 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.190127 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.190216 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.190434 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.190712 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.190808 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.191062 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.191167 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.191378 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.191468 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.191690 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.191886 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.192001 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.192213 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.192309 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.192524 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.192612 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.192834 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.192922 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.193145 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.193259 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.193472 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.193571 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.193766 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.193854 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.194074 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.194164 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.194381 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.194478 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.194688 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.194776 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.195024 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.195121 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.195352 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.195441 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.195661 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.195748 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.195973 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.196062 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.196285 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.196373 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.196598 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.196698 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.196909 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.196997 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.197219 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.197308 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.197524 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.197620 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.197837 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.197925 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.198149 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.198237 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.198456 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.198550 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.198762 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.198848 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.199165 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.199257 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.199476 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.199565 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.199782 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.199868 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.200088 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.200174 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.200393 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.200482 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.200703 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.200790 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.201014 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.201110 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.201322 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.201417 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.201631 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.201726 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.201938 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.202035 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.202245 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.202331 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.202559 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.202715 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.202874 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.203096 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.203213 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.203410 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.203546 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.203741 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.203842 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.204065 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.204320 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.204409 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.204632 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.204723 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.205506 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.205609 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.205829 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.205992 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.206152 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.206302 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.206465 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.206608 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.206782 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.206902 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.207129 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.207222 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.207431 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.207522 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.207732 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.207820 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.208041 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.208143 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.208346 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.208442 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.208648 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.208831 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.208991 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.209149 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.209305 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.209530 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.209684 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.209853 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.210014 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.210171 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.210318 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.210487 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.210674 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.210828 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.211038 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.211208 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.211355 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.211501 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.211647 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.211792 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.211947 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.212095 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.212263 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.212417 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.212562 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.212707 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.212879 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.213036 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.213183 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.213337 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.213975 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214072 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214155 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214242 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214330 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214410 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214489 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214581 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214663 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214751 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.214893 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.215016 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.215222 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.215315 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.215522 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.215610 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.215822 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.215913 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.216119 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.216214 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.216426 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.216515 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.216726 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.216816 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.217025 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.217118 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.217322 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.217408 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.217619 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.217704 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.217918 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.218005 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.218215 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.218301 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.218512 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.218611 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.218808 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.218902 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.219136 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.219226 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.219436 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.219536 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.219739 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.219826 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.220040 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.220190 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.220345 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.220483 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.220791 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.220890 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.221091 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.221182 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.221386 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.221486 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.221704 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.221800 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.222005 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.222092 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.222303 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.222392 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.222613 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.222748 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.225273 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.225437 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.225561 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.225680 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.225787 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.225893 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226006 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226111 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226226 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226333 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226438 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226542 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226656 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226763 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.226876 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227016 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227131 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227238 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227344 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227463 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227570 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227676 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227775 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227859 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.227939 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228031 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228112 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228192 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228279 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228360 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228360 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228515 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228605 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228720 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228828 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228920 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.228920 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.229113 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.229195 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.229275 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.229354 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.229433 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.229549 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.229711 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.229808 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.230019 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.230107 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.230326 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.230423 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.230673 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.230790 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.231004 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.231129 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.231305 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.231483 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.231611 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.231799 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.231922 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.232113 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.232258 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.232428 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.232573 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.232741 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.232885 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.233048 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.233196 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.233355 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.233507 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.233658 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.233813 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.233963 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.234116 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.234275 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.234418 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.234601 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.234720 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.234912 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.235070 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.235237 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.235647 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.235956 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.236703 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.236964 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.237055 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.237329 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.237548 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.237676 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.237865 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.237963 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.238186 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.238276 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.238508 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.238595 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.238820 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.238910 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.239169 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.239272 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.239479 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.239567 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.239791 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.239879 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.240109 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.240197 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.240418 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.240507 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.240748 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.240838 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.241048 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.241142 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.241354 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.241451 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.241654 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.241743 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.241959 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.242047 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.242272 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.242368 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.242572 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.242659 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.242868 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.242971 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.243191 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.243292 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.243496 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.243598 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.243799 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.243904 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.244092 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.244169 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.244425 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.244524 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.244684 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.244766 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.244980 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.245058 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.245276 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.245374 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.245576 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.245686 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.245868 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.245953 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.246303 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.246392 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.246552 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.246665 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.246830 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.246907 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.247159 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.247260 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.247455 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.247585 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.247755 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.247871 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.248040 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.248148 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.248334 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.248433 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.248632 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.248745 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.248925 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.249013 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.249222 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.249320 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.249519 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.249608 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.249846 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.249934 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.250167 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.250264 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.250473 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.250560 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.250781 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.250869 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.251116 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.251206 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.251481 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.251577 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.252302 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.252464 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.252605 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.252758 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.252925 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.253105 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.253228 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.253423 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.253528 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.253729 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.253819 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.254058 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.254158 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.254368 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.254488 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.254680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.254788 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.255007 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.255113 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.255320 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.255409 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.255626 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.255723 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.255932 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.256028 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.256258 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.256353 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.256574 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.256662 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.256874 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.256960 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.257179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.257267 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.257498 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.257585 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.257807 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.257938 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.258170 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.258277 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.258413 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.258515 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.258721 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.258820 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.259049 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.259140 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.259356 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.259444 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.259660 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.259758 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.259966 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.260061 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.260270 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.260358 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.260581 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.260668 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.260886 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.260973 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.261195 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.261285 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.261507 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.261595 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.261815 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.261909 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.262137 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.262224 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.262455 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.262543 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.262762 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.262866 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.263111 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.263203 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.263435 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.263525 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.263746 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.263836 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.264054 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.264151 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.264356 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.264445 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.264595 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 04:23:44.264697 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.265001 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.265307 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.265608 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:23:44.265847 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 04:23:44.419036 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Registered counter for database nova_api Oct 06 04:23:44.420017 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Registered counter for database nova_api Oct 06 04:23:44.441013 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:23:44.442849 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:23:44.447558 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:23:44.449348 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:23:44.504379 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.context [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1138271d-98fa-41e5-8be5-1f71544ce812(cell1) {{(pid=105410) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 04:23:44.506084 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.context [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1138271d-98fa-41e5-8be5-1f71544ce812(cell1) {{(pid=105411) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 04:23:44.508189 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:23:44.508655 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:23:44.509931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:23:44.510200 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:23:44.510400 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:23:44.510915 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:23:44.511383 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:23:44.511972 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:23:44.512693 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:23:44.513135 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:23:44.513342 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:23:44.515127 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:23:44.515317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Registered counter for database nova_cell0 Oct 06 04:23:44.517103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Registered counter for database nova_cell0 Oct 06 04:23:44.519911 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Registered counter for database nova_cell1 Oct 06 04:23:44.521980 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Registered counter for database nova_cell1 Oct 06 04:23:44.527278 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:23:44.528912 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:23:44.531447 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:23:44.532725 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:23:44.534485 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:23:44.537247 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:23:44.539585 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:23:44.541028 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:23:44.682082 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Registered counter for database nova_cell0 Oct 06 04:23:44.688898 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:23:44.689851 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Registered counter for database nova_cell0 Oct 06 04:23:44.693938 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:23:44.696896 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:23:44.701568 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:23:45.032548 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 04:23:45.037842 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 04:23:45.040409 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 04:23:45.045143 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 04:23:45.382742 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 04:23:45.388712 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 04:23:45.394177 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c3edc279c0 pid: 105410 (default app) Oct 06 04:23:45.396270 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:23:45.397433 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Oct 06 04:23:45.397537 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 04:23:45.398087 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Oct 6 04:23:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:23:45.403457 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-ac27cab2-9bad-4130-807b-3e92661c319e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 04:23:45.409251 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c3edc279c0 pid: 105411 (default app) Oct 06 04:25:07.579644 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:07.580659 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 06 04:25:07.581234 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:07.593824 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:07.594803 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell1:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:07.595888 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell0:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:07.597877 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:08.494069 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-7eb5bc40-715a-48bf-9080-33458658a36f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:08.527636 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-7eb5bc40-715a-48bf-9080-33458658a36f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939550 Oct 06 04:25:08.528362 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Oct 6 04:25:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:25:11.154927 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:11.155956 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-1031735e-ae6d-4631-8583-d115ec58e042 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Oct 06 04:25:11.156526 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:11.617897 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-9213e944-b6c2-43f7-8e18-334e4c3aa09c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "swap": 0, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:11.667181 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-9213e944-b6c2-43f7-8e18-334e4c3aa09c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504468 Oct 06 04:25:11.667743 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:25:11.682033 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:11.682888 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:11.683922 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell1:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:11.687597 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:11.893585 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-f50e1a7f-941f-4cd2-bfbb-2763257ddade admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:11.961915 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-f50e1a7f-941f-4cd2-bfbb-2763257ddade admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284945 Oct 06 04:25:11.962502 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 04:25:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:25:14.574690 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-9213e944-b6c2-43f7-8e18-334e4c3aa09c admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:14.576579 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-9213e944-b6c2-43f7-8e18-334e4c3aa09c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002408 Oct 06 04:25:14.577625 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:15.246914 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-117008aa-2911-40bd-83e7-3f432b2c08e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:15.289018 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-117008aa-2911-40bd-83e7-3f432b2c08e9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.705618 Oct 06 04:25:15.289611 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 04:25:15.301627 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-f2795c58-9022-4a26-9543-9a75c6f8693d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:15.341436 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-f2795c58-9022-4a26-9543-9a75c6f8693d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043478 Oct 06 04:25:15.342598 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 04:25:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:25:17.940597 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-117008aa-2911-40bd-83e7-3f432b2c08e9 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:17.941659 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-117008aa-2911-40bd-83e7-3f432b2c08e9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 06 04:25:17.942369 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:18.377436 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c2bec99f-a878-429b-ab6b-458c1b70a940 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "swap": 0, "vcpus": 1, "name": "ds1G", "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:18.397432 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c2bec99f-a878-429b-ab6b-458c1b70a940 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448587 Oct 06 04:25:18.398027 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:25:18.411702 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-4f4e1c91-33de-4607-bd99-759bcf888b4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:18.439790 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-4f4e1c91-33de-4607-bd99-759bcf888b4e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031788 Oct 06 04:25:18.440434 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 04:25:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:25:21.140204 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c2bec99f-a878-429b-ab6b-458c1b70a940 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:21.141487 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c2bec99f-a878-429b-ab6b-458c1b70a940 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001798 Oct 06 04:25:21.142119 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:21.567473 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b6d9201f-08c1-48b8-b190-53ea5ecf01be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:21.587351 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-b6d9201f-08c1-48b8-b190-53ea5ecf01be admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439066 Oct 06 04:25:21.590998 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 04:25:21.600519 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-8f8d8050-d9a8-43dc-9af8-9e22efe06869 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:21.631358 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-8f8d8050-d9a8-43dc-9af8-9e22efe06869 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034799 Oct 06 04:25:21.635621 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 04:25:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:25:24.269090 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b6d9201f-08c1-48b8-b190-53ea5ecf01be admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:24.270342 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-b6d9201f-08c1-48b8-b190-53ea5ecf01be admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Oct 06 04:25:24.270822 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:24.689255 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b9585c4c-b327-4528-abb1-f90726681025 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:24.708485 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b9585c4c-b327-4528-abb1-f90726681025 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430161 Oct 06 04:25:24.709049 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:25:24.723336 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-01daf622-ca0d-4791-9ba3-811583c5054c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:24.749068 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-01daf622-ca0d-4791-9ba3-811583c5054c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030800 Oct 06 04:25:24.749848 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Oct 6 04:25:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:25:27.662741 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b9585c4c-b327-4528-abb1-f90726681025 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:27.663772 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b9585c4c-b327-4528-abb1-f90726681025 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Oct 06 04:25:27.664204 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:25:28.111807 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-58d82bd4-a4db-43d9-a396-c243eba5ab03 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:28.137479 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-58d82bd4-a4db-43d9-a396-c243eba5ab03 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466285 Oct 06 04:25:28.138031 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Oct 6 04:25:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:25:30.838611 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b9585c4c-b327-4528-abb1-f90726681025 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:30.839653 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b9585c4c-b327-4528-abb1-f90726681025 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 06 04:25:30.840048 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:31.236061 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-de367cd7-1d86-4d5c-9a35-4ca0b27a73a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:31.257029 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-de367cd7-1d86-4d5c-9a35-4ca0b27a73a6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.410797 Oct 06 04:25:31.257875 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 04:25:31.270184 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b61eafd5-ca07-499c-988a-d70797a71523 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:31.298594 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b61eafd5-ca07-499c-988a-d70797a71523 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032465 Oct 06 04:25:31.302999 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 04:25:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:25:33.878362 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-de367cd7-1d86-4d5c-9a35-4ca0b27a73a6 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:33.879325 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-de367cd7-1d86-4d5c-9a35-4ca0b27a73a6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 06 04:25:33.879726 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:34.276633 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-bb58a1aa-a9f5-4010-a78f-fb493e06c784 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "disk": 20, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:34.296814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-bb58a1aa-a9f5-4010-a78f-fb493e06c784 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411030 Oct 06 04:25:34.297371 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 04:25:34.309343 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-f16f0719-452a-412c-8d69-23a50dc7a718 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:34.335872 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-f16f0719-452a-412c-8d69-23a50dc7a718 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030184 Oct 06 04:25:34.336466 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 04:25:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:25:37.014183 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-bb58a1aa-a9f5-4010-a78f-fb493e06c784 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:37.016018 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-bb58a1aa-a9f5-4010-a78f-fb493e06c784 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002533 Oct 06 04:25:37.016580 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:25:37.491742 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0e3bb327-865c-4887-8fb2-515487470a7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:37.518442 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0e3bb327-865c-4887-8fb2-515487470a7a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.494844 Oct 06 04:25:37.519348 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 04:25:37.534858 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-5653d1e0-37f5-4dff-a2df-e7307178d518 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:37.564680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-5653d1e0-37f5-4dff-a2df-e7307178d518 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036692 Oct 06 04:25:37.578987 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 04:25:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:25:40.184800 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0e3bb327-865c-4887-8fb2-515487470a7a admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:40.186463 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0e3bb327-865c-4887-8fb2-515487470a7a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Oct 06 04:25:40.186864 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:40.641029 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-9a6c9739-a0d2-40da-8c0f-f662dcd0ffc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:40.649522 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:40.666274 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-9a6c9739-a0d2-40da-8c0f-f662dcd0ffc1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471923 Oct 06 04:25:40.671108 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 04:25:40.681184 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2a912d3c-6604-41e8-994d-dff5bfc2c489 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:40.711879 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-2a912d3c-6604-41e8-994d-dff5bfc2c489 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035622 Oct 06 04:25:40.712373 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 04:25:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:25:43.392022 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-9a6c9739-a0d2-40da-8c0f-f662dcd0ffc1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:25:43.393029 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-9a6c9739-a0d2-40da-8c0f-f662dcd0ffc1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 06 04:25:43.393673 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:25:43.833050 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-c16698dd-32b9-41d3-a048-2dc555e82c26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:43.839949 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:25:43.856429 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-c16698dd-32b9-41d3-a048-2dc555e82c26 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.456680 Oct 06 04:25:43.859104 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Oct 6 04:25:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:25:43.869932 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-f95e8f79-3fca-4a5d-b5cf-32a61a3ca48f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:25:43.896487 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-f95e8f79-3fca-4a5d-b5cf-32a61a3ca48f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030094 Oct 06 04:25:43.897061 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Oct 6 04:25:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:26:01.586048 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-c16698dd-32b9-41d3-a048-2dc555e82c26 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:01.587130 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-c16698dd-32b9-41d3-a048-2dc555e82c26 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 06 04:26:01.587533 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:26:01.598736 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:26:01.977406 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-2cac9521-6446-4201-b33c-9b4d99c896ac admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:01.995471 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-2cac9521-6446-4201-b33c-9b4d99c896ac admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401251 Oct 06 04:26:01.996003 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Oct 6 04:26:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:26:03.305149 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-c16698dd-32b9-41d3-a048-2dc555e82c26 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:03.306170 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-c16698dd-32b9-41d3-a048-2dc555e82c26 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 06 04:26:03.306562 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:26:03.847414 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-e0a29d77-7909-4abd-944c-55e56c58087c admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:03.852587 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-e0a29d77-7909-4abd-944c-55e56c58087c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-e0a29d77-7909-4abd-944c-55e56c58087c admin admin] Request method failure captured: Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Accept: application/json Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Connection: keep-alive Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Content-Length: 0 Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Host: 10.222.0.33 Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.92 Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABjPljbWsELgM0fIKvBjGaXbfvQCxxldkz5MmdviCX3pFLn_k0BWA2FX4CQuY2MhLKLudxCKyvmdNf_pVcdo3ugWjSCAy20L80UMwP0G2Lzvv0vDIyX-f_crJOLK3xHXAvB23Rri1dlg9m669J59V3vjmp5E4a5CbY3ZdpbaU58tc-ZpfQ Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Role: admin,reader,member Oct 06 04:26:03.855814 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Roles: admin,reader,member Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7760d317949542fd9d86e529eca476cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7760d317949542fd9d86e529eca476cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant: admin Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User: admin Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Id: f6cec6cd063d4a0684ad9f283f12b406 Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Name: admin Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: method: > Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: exception: Flavor 42 could not be found. Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: action_args: {'id': '42'} Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:26:03.857470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:03.858503 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.859931 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-e0a29d77-7909-4abd-944c-55e56c58087c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:26:03.861226 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-e0a29d77-7909-4abd-944c-55e56c58087c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.402909 Oct 06 04:26:03.861226 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Oct 6 04:26:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:03.867336 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-ec123e5e-0c4e-440c-bcee-e83b4c785e59 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:03.891773 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-ec123e5e-0c4e-440c-bcee-e83b4c785e59 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027906 Oct 06 04:26:03.892320 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 04:26:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:26:03.902661 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-5402621d-3351-4f6a-8e3f-da6637990ad4 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:03.924515 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-5402621d-3351-4f6a-8e3f-da6637990ad4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026237 Oct 06 04:26:03.925046 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 04:26:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:26:03.934280 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-c54ab19c-4cd5-4452-aff3-1054a171b724 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:03.940103 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-c54ab19c-4cd5-4452-aff3-1054a171b724 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-c54ab19c-4cd5-4452-aff3-1054a171b724 admin admin] Request method failure captured: Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Accept: application/json Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Connection: keep-alive Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Content-Length: 0 Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Host: 10.222.0.33 Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjPljbWsELgM0fIKvBjGaXbfvQCxxldkz5MmdviCX3pFLn_k0BWA2FX4CQuY2MhLKLudxCKyvmdNf_pVcdo3ugWjSCAy20L80UMwP0G2Lzvv0vDIyX-f_crJOLK3xHXAvB23Rri1dlg9m669J59V3vjmp5E4a5CbY3ZdpbaU58tc-ZpfQ Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Role: admin,reader,member Oct 06 04:26:03.943317 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Roles: admin,reader,member Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7760d317949542fd9d86e529eca476cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7760d317949542fd9d86e529eca476cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant: admin Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User: admin Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Id: f6cec6cd063d4a0684ad9f283f12b406 Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Name: admin Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: method: > Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: exception: Flavor 42 could not be found. Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: action_args: {'id': '42'} Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:26:03.944850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:03.945850 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:03.947108 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-c54ab19c-4cd5-4452-aff3-1054a171b724 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:26:03.948365 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-c54ab19c-4cd5-4452-aff3-1054a171b724 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014024 Oct 06 04:26:03.948365 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Oct 6 04:26:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 06 04:26:05.200619 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-5402621d-3351-4f6a-8e3f-da6637990ad4 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:05.201641 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-5402621d-3351-4f6a-8e3f-da6637990ad4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Oct 06 04:26:05.202034 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:26:05.738360 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-4b983c86-d09e-4ef0-a8bf-547dc8429d90 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:05.744579 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-4b983c86-d09e-4ef0-a8bf-547dc8429d90 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-4b983c86-d09e-4ef0-a8bf-547dc8429d90 admin admin] Request method failure captured: Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Accept: application/json Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Connection: keep-alive Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Content-Length: 0 Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Host: 10.222.0.33 Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjPljdKOkfHPhe4lA6suVVPQBQerrAQQosO_oyAFiQvHfMokV6Kw80toA9sPWsEHV-z1-ANBsSRkE8TbJ_vkQDCodOJ5zxHQ8icv9-KWrGn004jKO_zEQzuycQl30OT26zo86RKeXA96THe3GyLPwMx1H1NhTDjXP9euk9rI-zTmWSaa0 Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Role: admin,reader,member Oct 06 04:26:05.746060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Roles: admin,reader,member Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7760d317949542fd9d86e529eca476cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7760d317949542fd9d86e529eca476cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant: admin Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User: admin Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Id: f6cec6cd063d4a0684ad9f283f12b406 Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Name: admin Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: method: > Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: exception: Flavor 84 could not be found. Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: action_args: {'id': '84'} Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:26:05.751179 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:05.752821 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.755569 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-4b983c86-d09e-4ef0-a8bf-547dc8429d90 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:26:05.758123 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-4b983c86-d09e-4ef0-a8bf-547dc8429d90 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.410359 Oct 06 04:26:05.758123 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Oct 6 04:26:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:05.761235 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c7e462c9-c378-4587-bb4f-9f07a4b649a3 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:05.778237 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c7e462c9-c378-4587-bb4f-9f07a4b649a3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021449 Oct 06 04:26:05.779631 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 04:26:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:26:05.789559 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0701ea42-5a60-45f6-9706-03a43ada0084 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:05.804890 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0701ea42-5a60-45f6-9706-03a43ada0084 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018954 Oct 06 04:26:05.805425 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 04:26:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:26:05.814644 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c0cdf47a-049a-4002-a716-7dae44425eae admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:05.819481 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-c0cdf47a-049a-4002-a716-7dae44425eae admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c0cdf47a-049a-4002-a716-7dae44425eae admin admin] Request method failure captured: Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Accept: application/json Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Connection: keep-alive Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Content-Length: 0 Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Host: 10.222.0.33 Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.92 Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABjPljdKOkfHPhe4lA6suVVPQBQerrAQQosO_oyAFiQvHfMokV6Kw80toA9sPWsEHV-z1-ANBsSRkE8TbJ_vkQDCodOJ5zxHQ8icv9-KWrGn004jKO_zEQzuycQl30OT26zo86RKeXA96THe3GyLPwMx1H1NhTDjXP9euk9rI-zTmWSaa0 Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Role: admin,reader,member Oct 06 04:26:05.821103 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Roles: admin,reader,member Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7760d317949542fd9d86e529eca476cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7760d317949542fd9d86e529eca476cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant: admin Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User: admin Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Id: f6cec6cd063d4a0684ad9f283f12b406 Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Name: admin Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: method: > Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: exception: Flavor 84 could not be found. Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: action_args: {'id': '84'} Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:26:05.822680 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:05.823781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:05.825227 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c0cdf47a-049a-4002-a716-7dae44425eae admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:26:05.826926 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c0cdf47a-049a-4002-a716-7dae44425eae admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011288 Oct 06 04:26:05.826926 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Oct 6 04:26:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:07.092889 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0701ea42-5a60-45f6-9706-03a43ada0084 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:07.093906 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0701ea42-5a60-45f6-9706-03a43ada0084 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 06 04:26:07.094309 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:26:07.620847 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-3f2e6a93-b7ec-4c8d-9f1c-97c3de85c4b6 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:07.627062 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-3f2e6a93-b7ec-4c8d-9f1c-97c3de85c4b6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-3f2e6a93-b7ec-4c8d-9f1c-97c3de85c4b6 admin admin] Request method failure captured: Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Accept: application/json Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Connection: keep-alive Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Content-Length: 0 Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Host: 10.222.0.33 Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.92 Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABjPljecTtNQdpj19P99nsbh8dETgaIJ-ti-qR8zb3MvxrltarisUaNGLOadr_JMJavu35rsPW3_R4xmHCp0oEawUaCmHkm-4RDSD7ODRbKDqxbl3yBlU2XpHNC6F0VJ_f9-dln8Gwp8l_VukRgfsX60dbQyujR1HHFrUBeLprXTP_WY4U Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Role: admin,reader,member Oct 06 04:26:07.628542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Roles: admin,reader,member Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7760d317949542fd9d86e529eca476cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7760d317949542fd9d86e529eca476cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant: admin Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User: admin Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Id: f6cec6cd063d4a0684ad9f283f12b406 Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: X-User-Name: admin Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: method: > Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: exception: Flavor 451 could not be found. Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: action_args: {'id': '451'} Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:26:07.630115 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:07.631063 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.632544 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-3f2e6a93-b7ec-4c8d-9f1c-97c3de85c4b6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:26:07.633781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-3f2e6a93-b7ec-4c8d-9f1c-97c3de85c4b6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393579 Oct 06 04:26:07.633781 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 04:26:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:07.640238 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-51795145-3ad7-4cde-a747-51dca3d59983 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:07.655103 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-51795145-3ad7-4cde-a747-51dca3d59983 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018937 Oct 06 04:26:07.655659 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 04:26:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:26:07.665190 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:07.680380 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018807 Oct 06 04:26:07.680928 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Oct 6 04:26:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:26:07.690862 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5727ad77-214b-43c3-a08b-f8163f855266 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:07.695810 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-5727ad77-214b-43c3-a08b-f8163f855266 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5727ad77-214b-43c3-a08b-f8163f855266 admin admin] Request method failure captured: Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Accept: application/json Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Connection: keep-alive Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Content-Length: 0 Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Host: 10.222.0.33 Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjPljecTtNQdpj19P99nsbh8dETgaIJ-ti-qR8zb3MvxrltarisUaNGLOadr_JMJavu35rsPW3_R4xmHCp0oEawUaCmHkm-4RDSD7ODRbKDqxbl3yBlU2XpHNC6F0VJ_f9-dln8Gwp8l_VukRgfsX60dbQyujR1HHFrUBeLprXTP_WY4U Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Role: admin,reader,member Oct 06 04:26:07.697332 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Roles: admin,reader,member Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7760d317949542fd9d86e529eca476cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7760d317949542fd9d86e529eca476cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7760d317949542fd9d86e529eca476cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant: admin Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 7760d317949542fd9d86e529eca476cc Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User: admin Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Id: f6cec6cd063d4a0684ad9f283f12b406 Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: X-User-Name: admin Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: method: > Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: exception: Flavor 451 could not be found. Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: action_args: {'id': '451'} Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:26:07.698919 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:07.699941 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Oct 06 04:26:07.702628 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5727ad77-214b-43c3-a08b-f8163f855266 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:26:07.704019 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-5727ad77-214b-43c3-a08b-f8163f855266 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011464 Oct 06 04:26:07.704019 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 04:26:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 04:26:08.902657 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:08.904331 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 06 04:26:08.904811 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:26:09.433338 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-733bdbad-ad7b-438b-9f01-a89f3af70a6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:26:09.453119 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-733bdbad-ad7b-438b-9f01-a89f3af70a6d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.409223 Oct 06 04:26:09.453695 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Oct 6 04:26:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:26:10.660551 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:10.661545 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 06 04:26:10.661930 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:26:11.180175 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-76c4d546-b645-44c0-a780-ca7e932b63c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:26:11.198088 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-76c4d546-b645-44c0-a780-ca7e932b63c8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.399928 Oct 06 04:26:11.198622 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Oct 6 04:26:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 04:26:12.416252 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:12.417251 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 06 04:26:12.417641 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:26:12.940296 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-382b9e01-c992-44da-90ae-89e2c3b20285 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:26:12.959253 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-382b9e01-c992-44da-90ae-89e2c3b20285 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.405210 Oct 06 04:26:12.959788 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Oct 6 04:26:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:26:14.175993 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:14.176998 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 06 04:26:14.177387 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:26:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:26:14.694571 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-d097f4f1-b7a7-49eb-b74d-351b975cee6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:26:14.713152 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-d097f4f1-b7a7-49eb-b74d-351b975cee6b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397870 Oct 06 04:26:14.713703 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Oct 6 04:26:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:26:15.936470 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:15.937481 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 06 04:26:15.937881 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:26:16.465522 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-236f0fd5-733c-474f-9d30-bf89eab75690 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:26:16.486191 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-236f0fd5-733c-474f-9d30-bf89eab75690 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.407257 Oct 06 04:26:16.487068 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Oct 6 04:26:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:27:13.490267 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:27:13.491313 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-b60fef05-bb93-424b-9477-c89d1beb0f51 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 06 04:27:13.491718 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Thu Oct 6 04:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:27:13.502827 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:13.880060 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-40619ae0-7238-41cb-b074-b65ac0241501 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:27:13.900465 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-40619ae0-7238-41cb-b074-b65ac0241501 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402767 Oct 06 04:27:13.901000 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Oct 6 04:27:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:27:13.922417 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=14 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:27:13.926131 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-5a6c0519-e3a5-4ae6-bb4b-cece03666335 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:27:13.933549 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-5a6c0519-e3a5-4ae6-bb4b-cece03666335 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012572 Oct 06 04:27:13.934066 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Oct 6 04:27:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:27:13.945481 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b49e537c-ddd8-4983-9c04-edb4519cdb09 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:27:13.953165 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-b49e537c-ddd8-4983-9c04-edb4519cdb09 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011213 Oct 06 04:27:13.953676 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Oct 6 04:27:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:27:13.964841 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:27:13.972469 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011126 Oct 06 04:27:13.972979 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Oct 6 04:27:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:27:13.984633 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-f1e40b65-50a2-47f7-a279-9faf88bbb062 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:27:13.991959 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-f1e40b65-50a2-47f7-a279-9faf88bbb062 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011282 Oct 06 04:27:13.992470 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Oct 6 04:27:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:30:14.853954 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:30:14.854984 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 06 04:30:14.856259 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:30:15.001546 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=6 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:30:15.159642 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b79d0e0b-435f-4fca-b615-0d8d660d5daa admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:30:15.164318 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-b79d0e0b-435f-4fca-b615-0d8d660d5daa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:30:15.164789 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-b79d0e0b-435f-4fca-b615-0d8d660d5daa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:30:15.165214 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-b79d0e0b-435f-4fca-b615-0d8d660d5daa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:30:15.165927 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-b79d0e0b-435f-4fca-b615-0d8d660d5daa admin admin] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:30:15.166369 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-b79d0e0b-435f-4fca-b615-0d8d660d5daa admin admin] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:30:15.166783 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-b79d0e0b-435f-4fca-b615-0d8d660d5daa admin admin] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:30:15.199677 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-b79d0e0b-435f-4fca-b615-0d8d660d5daa admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199264 Oct 06 04:30:15.201322 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 04:30:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:30:16.286573 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:30:16.287597 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 06 04:30:16.287988 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:30:16.477225 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-fbdd41a3-549d-46ea-97cd-c3d92d6fe0fc admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:30:16.480766 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-fbdd41a3-549d-46ea-97cd-c3d92d6fe0fc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:30:16.481235 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-fbdd41a3-549d-46ea-97cd-c3d92d6fe0fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:30:16.481655 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-fbdd41a3-549d-46ea-97cd-c3d92d6fe0fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:30:16.482352 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-fbdd41a3-549d-46ea-97cd-c3d92d6fe0fc admin admin] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:30:16.482789 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-fbdd41a3-549d-46ea-97cd-c3d92d6fe0fc admin admin] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:30:16.483220 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-fbdd41a3-549d-46ea-97cd-c3d92d6fe0fc admin admin] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:30:16.502984 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-fbdd41a3-549d-46ea-97cd-c3d92d6fe0fc admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076926 Oct 06 04:30:16.503540 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 04:30:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:30:28.039542 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:30:28.040537 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Oct 06 04:30:28.040929 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:30:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:30:28.184355 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:30:28.185072 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell1:SELECT=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:30:28.185684 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=8 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:30:28.234268 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-95f6566b-246d-4a32-9e2f-7d97948a0578 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:30:28.237756 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-95f6566b-246d-4a32-9e2f-7d97948a0578 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:30:28.238235 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-95f6566b-246d-4a32-9e2f-7d97948a0578 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:30:28.238666 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-95f6566b-246d-4a32-9e2f-7d97948a0578 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:30:28.239410 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-95f6566b-246d-4a32-9e2f-7d97948a0578 admin admin] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:30:28.239858 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-95f6566b-246d-4a32-9e2f-7d97948a0578 admin admin] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:30:28.240276 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-95f6566b-246d-4a32-9e2f-7d97948a0578 admin admin] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:30:28.266616 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-95f6566b-246d-4a32-9e2f-7d97948a0578 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.087258 Oct 06 04:30:28.267150 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 04:30:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:30:29.348322 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:30:29.349352 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-7edcaf41-cb10-4421-902c-4cfb06245fa8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 06 04:30:29.349739 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Oct 6 04:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:30:29.540468 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5ce47561-8cff-492e-a8dc-d5e88fced737 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:30:29.544260 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5ce47561-8cff-492e-a8dc-d5e88fced737 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:30:29.544734 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5ce47561-8cff-492e-a8dc-d5e88fced737 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:30:29.545188 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5ce47561-8cff-492e-a8dc-d5e88fced737 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:30:29.545892 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5ce47561-8cff-492e-a8dc-d5e88fced737 admin admin] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:30:29.546333 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5ce47561-8cff-492e-a8dc-d5e88fced737 admin admin] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:30:29.546744 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5ce47561-8cff-492e-a8dc-d5e88fced737 admin admin] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:30:29.568316 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-5ce47561-8cff-492e-a8dc-d5e88fced737 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079592 Oct 06 04:30:29.568864 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Oct 6 04:30:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:31:26.364355 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: Thu Oct 6 04:31:26 2022 - graceful shutdown triggered... Oct 06 04:31:26.364495 dv-cinder-860227-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 06 04:31:26.365432 dv-cinder-860227-2-iscsi devstack@n-api.service[105410]: Gracefully killing worker 1 (pid: 105410)... Oct 06 04:31:26.365874 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: Gracefully killing worker 2 (pid: 105411)... Oct 06 04:31:26.491700 dv-cinder-860227-2-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=4 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:31:27.366510 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: worker 1 buried after 1 seconds Oct 06 04:31:27.366510 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: worker 2 buried after 1 seconds Oct 06 04:31:27.366510 dv-cinder-860227-2-iscsi devstack@n-api.service[105409]: goodbye to uWSGI. Oct 06 04:31:27.368382 dv-cinder-860227-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 06 04:31:27.368913 dv-cinder-860227-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 06 04:31:27.371819 dv-cinder-860227-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 04:31:27.385702 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 04:31:27 2022] *** Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: nodename: dv-cinder-860227-2-iscsi Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: machine: x86_64 Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: clock source: unix Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: pcre jit disabled Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: detected number of CPU cores: 4 Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: current working directory: / Oct 06 04:31:27.388579 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: detected binary path: /usr/bin/uwsgi-core Oct 06 04:31:27.389390 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: your processes number limit is 47680 Oct 06 04:31:27.389390 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: your memory page size is 4096 bytes Oct 06 04:31:27.389390 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: detected max file descriptor number: 2048 Oct 06 04:31:27.389390 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: lock engine: pthread robust mutexes Oct 06 04:31:27.389390 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: thunder lock: enabled Oct 06 04:31:27.389390 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 04:31:27.389390 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 04:31:27.435989 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: Python main interpreter initialized at 0x5627a2f5f9c0 Oct 06 04:31:27.435989 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: python threads support enabled Oct 06 04:31:27.435989 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: your server socket listen backlog is limited to 100 connections Oct 06 04:31:27.435989 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: your mercy for graceful operations on workers is 90 seconds Oct 06 04:31:27.436468 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 04:31:27.436468 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: *** Operational MODE: preforking *** Oct 06 04:31:27.436719 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: *** uWSGI is running in multiple interpreter mode *** Oct 06 04:31:27.436719 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: spawned uWSGI master process (pid: 127080) Oct 06 04:31:27.436897 dv-cinder-860227-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 06 04:31:27.437492 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: spawned uWSGI worker 1 (pid: 127097, cores: 1) Oct 06 04:31:27.438005 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: spawned uWSGI worker 2 (pid: 127098, cores: 1) Oct 06 04:31:27.438300 dv-cinder-860227-2-iscsi devstack@n-api.service[127080]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 04:31:28.096663 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 04:31:28.104745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 04:31:29.252717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:31:29.252717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: from cryptography.utils import int_from_bytes Oct 06 04:31:29.253348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:31:29.253348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: from cryptography.utils import int_from_bytes Oct 06 04:31:29.267635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:31:29.267635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: from cryptography.utils import int_from_bytes Oct 06 04:31:29.268179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 04:31:29.268179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: from cryptography.utils import int_from_bytes Oct 06 04:31:31.677425 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 04:31:31.677979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 04:31:31.678245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 04:31:31.678616 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 04:31:31.678866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 04:31:31.679313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.679633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.679958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.680282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.680615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.680929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.681257 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.681576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.681918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.682172 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.682490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.682999 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860227-2-iscsi {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.683848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.684365 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.684474 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.684786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.685094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.685418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.685744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.686267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.686720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.687054 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.687375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.687722 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.688041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.688354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.688688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.689001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.689328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.689651 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.690054 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860227-2-iscsi {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.690380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.690706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.691035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.691461 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.691774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.692085 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.692415 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.692752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.693067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.693397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.693717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.694036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.694358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.694661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.694989 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.695303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.695624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.695931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.696239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.696493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.696800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.697121 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.697441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.697764 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.698017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.698269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.698594 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.699591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.700257 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.700481 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.700796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.701060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 04:31:31.701478 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.701560 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 04:31:31.701647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.701730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.701844 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 04:31:31.702001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.702213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 04:31:31.702313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.702471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 04:31:31.702615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.702864 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.702999 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.703220 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.703542 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.703851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.703954 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.704172 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.704267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.704482 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.704588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.704803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.704905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.705120 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.705222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.705427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.705534 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.705693 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.705798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.706069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.706184 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.706375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.706524 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860227-2-iscsi {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.706697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.706906 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.707099 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.707247 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.707379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.707565 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.707684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.707901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.708026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.708208 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.708338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.708530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.708647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.708850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.708967 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.709089 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.709367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.709507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.709677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.709801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.710021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.710157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.710275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.710390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.710579 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.710697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.710943 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.712379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.712554 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.712652 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.712737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.712820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.712911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713005 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713354 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713436 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860227-2-iscsi {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713619 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713885 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.713979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.714067 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.714150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.714150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.714299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.714429 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.714731 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.714835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.714926 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.715168 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.715311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.715587 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.715806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.715922 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.716120 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.716233 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.716506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.716711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.716815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.717119 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.717304 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.717442 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.717545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.717749 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.717841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.718055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.718153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.718367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.718457 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.718678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.718769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.719025 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.719121 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.719335 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.719438 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.719639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.719730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.719892 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.719983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.720199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.720298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.720521 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.720619 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.720842 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.720942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.721147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.721250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.721402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.721509 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.721651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.721742 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.721973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.722064 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.722295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.722394 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.722602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.722700 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.722900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.723016 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.723248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.723347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.723554 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.723643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.723861 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.723958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.724165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.724256 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.724467 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.724566 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.724773 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.724868 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.725094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.725192 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.725410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.725507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.725731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.725820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.726036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.726138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.726357 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.726467 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.726698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.726798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.727028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.727134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.727326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.727427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.727645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.727745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.727970 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.728061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.728278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.728373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.728595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.728693 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.728910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.729001 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.729215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.729305 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.729522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.729622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.729828 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.729917 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.730173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.730281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.730505 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.730597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.730808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.730952 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.731072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.731295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.731396 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.731622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.731720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.732061 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.732261 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.732359 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.732565 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.732907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.733003 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.733086 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.733169 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.733265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.733444 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.733535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.733747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.733844 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.734049 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.734165 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.734351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.734482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.734654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.734799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.735003 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.735140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.735278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.735487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.735586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.735804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.735903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.736120 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.736210 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.736442 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.736554 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.736755 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.736854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.737061 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.737157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.737366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.737465 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.737672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.737763 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.737976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.738076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.738292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.738390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.738593 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.738689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.738896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.739022 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.739246 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.739336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.739550 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.739642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.739856 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.739956 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.740173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.740264 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.740478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.740579 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.740783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.740874 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.741095 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.741185 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.741390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.741493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.741700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.742048 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.742264 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.742362 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.742571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.742660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.742878 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.743019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.743206 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.743299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.743520 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.743614 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.743824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.743914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.744129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.744228 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.744432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.744521 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.744736 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.744836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.745034 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.745125 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.745353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.745452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.745667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.746278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.746505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.746603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.746825 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.746916 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.747167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.747270 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.747480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.747575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 04:31:31.747811 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.747911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.748125 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.748230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.748436 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.748537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.748767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.748866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.749077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.749168 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.749386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.749476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.749704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.749802 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.750022 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.750121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.750336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.750426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.750649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.750741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.750980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.751074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.751305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.751396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.751617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.751718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.751932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.752033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.752248 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.752372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.752577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.752723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.752883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.752973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.753201 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.753289 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.753523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.753670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.753838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.753936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.754141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.754241 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.754455 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.754555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.754762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.754860 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.755093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.755198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.755400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.755504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.755713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.755804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.756020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.756110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.756327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.756419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.756634 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.756735 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.756940 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.757039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.757247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.757348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.757574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.757707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.757888 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.757982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.758195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.758297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.758501 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.758591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.758813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.758903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.759186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.759278 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.759493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.759589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.759808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.759911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.760121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.760219 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.760432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.760531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.760743 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.760846 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.761055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.761153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.761453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.761557 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.761796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.761933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.762116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.762308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.762434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.762629 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.762731 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.762944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.763055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.763288 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.763392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.763603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.763704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.763915 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.764008 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.764226 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.764323 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.764532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.764631 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.764838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.764936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.765143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.765233 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.765454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.765553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.765759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.765852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.766080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.766177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.766409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.766507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.766718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.766816 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.767079 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.767187 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.767390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.767488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.767703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.767841 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.768016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.768116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.768328 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.768419 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.768635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.768732 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.768948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.769046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.769258 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.769356 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.769562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.769652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.769883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.769980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.770194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.770284 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.770501 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.770599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.770819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.770908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.771151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.771245 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.771460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.771549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.771776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.771880 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.772096 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.772195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.772409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.772551 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.772721 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.772893 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.773029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.773119 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.773346 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.773442 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.773655 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.773758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.773968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.774066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.774275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.774364 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.774586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.774685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.774901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.775030 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.775248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.775339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.775566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.775659 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.775883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.775981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.776185 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.776275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.776499 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.776599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.776806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.776896 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.777142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.777243 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.777552 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.777748 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.777858 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.777999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.778188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.778282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.778505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.778604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.778808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.778897 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.779141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.779246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.779448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.779547 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.779766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.779862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.780078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.780176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.780386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.780476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.780692 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.780781 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.780994 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.781092 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.781301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.781398 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.781633 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.781729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.781955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.782057 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.782266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.782360 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.782588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.782686 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.782916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.783038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.783255 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.783344 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.783568 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.783668 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.783879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.783969 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.784189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.784279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.784498 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.784594 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.784812 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.784910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.785122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.785212 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.785434 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.785530 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.785744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.785835 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.786057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.786155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.786369 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.786469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.786682 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.786779 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.787012 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.787105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.787323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.787427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.787633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.787730 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.787944 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.788043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.788258 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.788361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.788586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.788691 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.788905 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.789171 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.789263 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.789514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.789606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.789824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.789922 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.790137 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.790236 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.790447 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.790546 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.790756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.790861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.791108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.791212 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.791419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.791509 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.791747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.791847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.792059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.792159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.792375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.792474 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.793222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.793446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.793580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.793697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.793836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.793965 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.794149 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.794287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.794459 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.794620 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.794769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.794994 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.795107 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.795297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.795396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.795614 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.795711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.795939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.796039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.796254 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.796353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.796570 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.796667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.796887 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.797023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.797194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.797297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.797498 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.797589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.797808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.797912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.798127 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.798218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.798439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.798540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.798751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.798851 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.799082 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.799176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.799404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.799507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.799718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.799817 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.800025 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.800116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.800334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.800440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.800649 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.800748 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.800973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.801064 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.801290 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.801405 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.801614 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.801712 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.801923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.802021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.802231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.802331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.802536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.802635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.802848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.802938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.803186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.803323 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.803494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.803591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.804142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.804232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.804402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.804491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.804580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.804665 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.804755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.804840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.805018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.805118 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.805337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.805436 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.805663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.805762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.805977 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.806069 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.806290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.806380 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.806599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.806697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.806902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.807065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.807245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.807339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.807559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.807660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.807867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.807957 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.808175 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.808314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.808535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.808626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.808852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.809010 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.809168 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.809331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.809476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.809658 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.809783 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.809973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.810098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.810288 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.810415 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.810600 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.810725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.810907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.811077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.811246 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.811468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.811562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.811691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.811999 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.812124 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.812312 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.812467 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.812622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.812783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.812932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.813105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.813244 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.813450 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.813571 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.813770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.813892 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.814102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.814200 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.814431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.814531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.814747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.814847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.815080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.815186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.815393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.815491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.815699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.815803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.816007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.816109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.816315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.816460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.816621 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.816720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.816925 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.817022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.817227 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.817367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.817537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.817637 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.817844 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.817942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.818150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.818240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.818454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.818545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.818756 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.818890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.819093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.819196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.819400 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.819492 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.819717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.819849 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.820024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.820128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.820355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.820458 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.820666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.820764 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.820975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.821087 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.821282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.821409 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.821584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.821675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.821895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.822004 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.822268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.822379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.822527 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.822641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.822843 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.822948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.823175 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.823279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.823482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.823616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.823807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.824619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.824843 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.825154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.825330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.825481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.825665 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.825799 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.825995 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.826115 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.826328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.826427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.826639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.826740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.826972 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.827067 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.827294 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.827425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.827612 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.827713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.827928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.828021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.828244 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.828336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.828560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.828654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.828871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.828998 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.829177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.829285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.829493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.829583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.829803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.829894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.830110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.830220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.830414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.830513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.830727 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.830825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.831058 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.831165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.831366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.831456 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.831683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.831788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.831985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.832086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.832300 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.832430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.832603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.832693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.832909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.833001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.833214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.833311 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.833523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.833880 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.834022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.834115 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.834238 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.834347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.834455 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.834579 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.834740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.834842 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.835077 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.835183 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.835387 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.835478 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.835702 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.835794 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.836009 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.836109 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.836317 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.836470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.836627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.836788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.836951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.837104 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.837268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.837419 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.837575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.837727 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.837886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.838035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.838190 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.838348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.838496 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.838677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.838800 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.839011 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.839154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.839313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.839413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.839778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.839874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.840098 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.840270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.840405 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.840496 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.840709 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.840800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.841032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.841178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.841345 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.841496 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.841651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.841805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.841956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.842214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.842315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.842531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.842631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.842848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.842999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.843221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.843315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.843549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.843640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.843867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.843969 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.844174 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.844264 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.844484 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.844576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.844797 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.844896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.845107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.845203 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.845413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.845506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.845731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.845831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.846045 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.846136 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.846353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.846450 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.846653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.846757 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.846999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.847106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.847300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.847399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.847612 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.847713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.847922 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.848057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.848244 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.848389 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.848566 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.848706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.848889 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.849033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.849194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.849363 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.849505 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.849681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.849815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.849992 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.850123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.850309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.850415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.850622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.850714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.850933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.851097 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.851283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.851389 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.851593 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.851685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.851908 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.851999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.852225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.852317 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.852540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.852681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.852848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.852940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.853157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.853251 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.853459 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.853557 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.853781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.853907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.854602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.854728 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.854824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.854909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.855028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.855628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.855726 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.855819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.855903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.855984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.856113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.856359 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.856542 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.856682 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.856853 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.856994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.857165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.857304 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.857472 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.857616 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.857784 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.857967 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.858095 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.858277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.858412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.858605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.858729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.858942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.859057 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.859298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.859471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.859615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.859785 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.859958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.860096 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.860290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.860408 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.860615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.860706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.860932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.861030 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.861253 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.861350 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.861613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.861715 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.861919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.862210 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.862304 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.862513 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.862788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.862996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.863159 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.863418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.863510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.863899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.863988 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.865563 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.865689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.865778 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.865862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.865945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866128 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866223 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866568 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.866744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.867123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.867211 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.867297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.867395 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.867671 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.867744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.867948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.868042 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.868275 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.868591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.868691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.868911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.869203 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.869295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.869533 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.869779 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.869879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.870164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.870449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.870541 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.871463 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.871671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.871793 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.872160 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.872264 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.872438 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.872544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.872768 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.872868 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.873078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.873177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.873391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.873491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.873708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.873808 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.874686 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.874789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.874876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875014 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875199 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875564 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875731 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875851 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.875988 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.876162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.876308 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.876468 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.876797 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.877079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.877172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.877267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.877419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.877521 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.877738 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.877914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.878070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.878231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.878373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.878493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.878667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.878819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.879019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.879336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.879644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.879952 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.880256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.880601 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.880908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.881232 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.881562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.881894 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.882205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.882539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.882866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.883218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.883533 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.883852 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.884180 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.884321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.884485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.884679 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.884773 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.885043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.885136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.885376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.885477 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.885680 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.885820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.885983 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.886170 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.886293 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.886624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.886723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.886927 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.887055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.887256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.887364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.887581 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.887695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.887886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.888023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.888208 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.888488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.888597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.888813 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.888903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.889118 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.889224 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.889422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.889514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.889767 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.889869 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.890073 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.890213 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.890391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.890485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.890701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.890799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.891037 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.891132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.891357 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.891447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.891670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.891762 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.891983 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.892081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.892293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.892427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.892604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.892694 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.892916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.893008 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.893236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.893326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.893546 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.893652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.893858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.893950 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.894173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.894266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.894486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.894622 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.894910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.895069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.895397 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.895487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.895713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.895819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.896027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.896118 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.896340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.896431 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.896653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.896812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.896964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.897276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.897587 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.897684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.897899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.898210 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.898383 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.898543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.898866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.899220 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.899494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.899587 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.899829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.899929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.900165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.900480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.900797 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.900896 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.901153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.901254 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.901468 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.901773 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.902162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.902338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.902475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.902699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.902792 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.903117 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.903212 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.903430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.903522 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.903746 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.903856 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.904059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.904167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.904373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.904464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.904683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.904909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.905017 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.905267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.905359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.905592 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.905692 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.905924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.906017 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.906243 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.906334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.906561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.906652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.906867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.906972 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.907218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.907320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.907528 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.907741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.907833 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.908062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.908161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.908399 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.908487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.908728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.908820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.909030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.909127 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.909343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.909436 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.909654 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.909748 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.909961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.910053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.910272 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.910369 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.910574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.910664 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.910880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.911013 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.911220 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.911325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.911520 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.911611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.911824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.911916 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.912132 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.912233 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.912435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.912526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.912733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.912826 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.913035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.913139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.913335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.913579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.913671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.913929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.914036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.914247 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.914345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.914577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.914670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.914903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.915034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.915252 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.915348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.915561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.915653 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.915860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.915964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.916177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.916303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.916478 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.916575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.916780 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.916882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.917088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.917193 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.917392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.917492 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.918378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.918504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.918657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.918768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.918861 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.918947 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.919134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.919236 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.919446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.919538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.919752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.920053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.920154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.920372 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.920463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.920676 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.920772 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.920982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.921088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.921294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.921386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.921600 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.921700 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.921902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.921994 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.922204 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.922295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.922508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.922599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.922817 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.922914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.923155 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.923259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.923466 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.923561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.923774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.923903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.924084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.924183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.924392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.924491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.924698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.924798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.925007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.925103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.925315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.925420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.925622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.925722 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.925929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.926029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.926236 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.926336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.926541 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.926634 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.926847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.926938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.927182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.927294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.927501 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.927591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.927822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.927920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.928135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.928236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.928447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.928672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.928764 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.929006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.929174 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.929328 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.929427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.929642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.929739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.929948 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.930053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.930260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.930363 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.930567 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.930656 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.930873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.930993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.931199 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.931289 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.931527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.931626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.931843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.931943 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.932156 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.932255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.932471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.932570 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.932783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.932921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.933094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.933186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.934019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.934180 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.934330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.934472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.934903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.935093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.935218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.935325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.935427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.935520 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.935605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.935785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.935877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.936113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.936206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.936437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.936537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.936741 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.936839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.937045 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.937138 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.937347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.937446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.937657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.937759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.937973 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.938066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.938281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.938372 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.938587 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.938851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.939077 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.939222 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.939314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.939548 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.939647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.939864 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.940017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.940164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.940317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.940473 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.940621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.940901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.941037 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.941218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.941343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.941518 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.941679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.941852 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.941977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.942169 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.942268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.942543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.942681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.942809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.942911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.943150 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.943293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.943475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.943580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.943789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.943931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.944124 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.944238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.944464 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.944569 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.944791 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.944886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.945115 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.945257 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.945408 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.945508 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.945714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.945920 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.946080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.946315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.946437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.946635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.946734 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.946944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.947068 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.947297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.947397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.947602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.947693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.947915 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.948012 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.948221 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.948321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.948524 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.948621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.948827 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.949204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.949313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.949399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.949483 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.949621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.949756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.949935 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.950061 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.950248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.950389 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.950559 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.950652 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.950870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.950996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.951205 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.951356 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.951531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.951623 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.951852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.951946 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.952155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.952244 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.952460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.952551 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.952764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.952894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.953069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.953160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.953380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.953474 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.953686 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.953786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.954011 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.954111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.954320 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.954425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.954628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.954728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.954937 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.955067 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.955268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.955414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.955577 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.955679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.955890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.955990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.956198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.956304 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.956509 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.956640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.956819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.956918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.957133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.957226 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.957441 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.957532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.957751 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.957844 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.958062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.958182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.958371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.958498 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.958681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.958773 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.959029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.959126 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.959350 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.959449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.959654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.959751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.959978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.960070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.960292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.960392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.960596 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.960695 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.960900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.961028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.961126 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 04:31:31.961220 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.961519 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.961831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.962140 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.962450 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.962760 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.963099 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.963418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.963735 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.964048 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.964367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.964795 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.965126 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.965455 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.965768 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.966097 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.966425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.966773 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.967112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.967461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.967791 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.968109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.968422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.968729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 04:31:31.968972 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 04:31:32.023621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO dbcounter [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Registered counter for database nova_api Oct 06 04:31:32.031367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO dbcounter [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Registered counter for database nova_api Oct 06 04:31:32.044597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_db.sqlalchemy.engines [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:31:32.051396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writer thread running {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:31:32.051694 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_db.sqlalchemy.engines [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:31:32.058229 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writer thread running {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:31:32.106993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.context [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1138271d-98fa-41e5-8be5-1f71544ce812(cell1) {{(pid=127097) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 04:31:32.111025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:31:32.111498 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:31:32.113067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:31:32.113799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:31:32.114240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:31:32.115528 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.context [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1138271d-98fa-41e5-8be5-1f71544ce812(cell1) {{(pid=127098) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 04:31:32.116437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:31:32.118673 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO dbcounter [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Registered counter for database nova_cell0 Oct 06 04:31:32.119941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:31:32.120421 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:31:32.122789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:31:32.123550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO dbcounter [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Registered counter for database nova_cell1 Oct 06 04:31:32.123650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:31:32.123999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:31:32.126142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:31:32.128028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO dbcounter [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Registered counter for database nova_cell0 Oct 06 04:31:32.130855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_db.sqlalchemy.engines [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:31:32.132172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO dbcounter [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Registered counter for database nova_cell1 Oct 06 04:31:32.135820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writer thread running {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:31:32.138718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_db.sqlalchemy.engines [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:31:32.139535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_db.sqlalchemy.engines [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:31:32.141770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_db.sqlalchemy.engines [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:31:32.148473 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writer thread running {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:31:32.154182 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writer thread running {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:31:32.294230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writer thread running {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:31:32.301853 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO dbcounter [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Registered counter for database nova_cell0 Oct 06 04:31:32.302880 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO dbcounter [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Registered counter for database nova_cell0 Oct 06 04:31:32.309041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_db.sqlalchemy.engines [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:31:32.314050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writer thread running {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:31:32.317048 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_db.sqlalchemy.engines [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 04:31:32.322006 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writer thread running {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 04:31:32.647833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: WARNING keystonemiddleware.auth_token [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 04:31:32.651335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: WARNING keystonemiddleware.auth_token [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 04:31:32.655986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: WARNING keystonemiddleware.auth_token [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 04:31:32.659284 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: WARNING keystonemiddleware.auth_token [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 04:31:33.012501 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: WARNING keystonemiddleware.auth_token [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 04:31:33.013156 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: WARNING keystonemiddleware.auth_token [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 04:31:33.018487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: WARNING keystonemiddleware.auth_token [None req-3c6b8479-fbcc-4bac-85e6-f8a44d44a221 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 04:31:33.018641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: WARNING keystonemiddleware.auth_token [None req-775d3a57-bcc9-4414-b773-a02663154fd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 04:31:33.023800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627a2f5f9c0 pid: 127097 (default app) Oct 06 04:31:33.023964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627a2f5f9c0 pid: 127098 (default app) Oct 06 04:32:08.126793 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:08.128475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:08.129603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:08.130523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:09.446107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7a5eb232-f1ef-46f5-a063-e1f495746a7e tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Action: 'create', calling method: .version_select at 0x7f0c43a814c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2083088413", "metadata": {"Type": "work"}}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:09.631599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:09.632436 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:09.633152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:09.633894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:10.735677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-052c22c3-0776-4d08-80d6-2fe745e6fbc0 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Action: 'create', calling method: .version_select at 0x7f0c43a83550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-332700867", "metadata": {"Type": "work"}}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-052c22c3-0776-4d08-80d6-2fe745e6fbc0 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Request method failure captured: Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 121 Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpJT1W5J-czIObdRPp7daT1cScMH8l45ar9lhyt9sj0JZWkRV-7MXF0MySPJRZodCVVXQrKFL8o9qlZJ0b8sDUFgOhpugMzWnpGGYstjt_LKWp7gWmWJaOKPlHY5HDRj0tbj_uojMkOlDFdhsEoR3F8HT7bnVshGmbxJQE_wPAlVlM Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:32:10.741986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 06932e0595d442bdaa2f825384222551 Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-332700867", "metadata": {"Type": "work"}}} Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:32:10.746293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-332700867', 'metadata': {'Type': 'work'}}}} Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise error Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi '#$%' Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:32:10.747276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 04:32:10.748650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 04:32:10.749841 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 04:32:10.749841 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.749841 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-052c22c3-0776-4d08-80d6-2fe745e6fbc0 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:32:10.749841 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-052c22c3-0776-4d08-80d6-2fe745e6fbc0 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.130199 Oct 06 04:32:10.749841 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Oct 6 04:32:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 06 04:32:10.758156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2a86a6f6-09b4-40b0-8732-2a6e471b8661 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Action: 'create', calling method: .version_select at 0x7f0c43a83ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1848604831", "metadata": {"Type": "work"}}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2a86a6f6-09b4-40b0-8732-2a6e471b8661 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Request method failure captured: Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 120 Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpJT1W5J-czIObdRPp7daT1cScMH8l45ar9lhyt9sj0JZWkRV-7MXF0MySPJRZodCVVXQrKFL8o9qlZJ0b8sDUFgOhpugMzWnpGGYstjt_LKWp7gWmWJaOKPlHY5HDRj0tbj_uojMkOlDFdhsEoR3F8HT7bnVshGmbxJQE_wPAlVlM Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:32:10.763157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 06932e0595d442bdaa2f825384222551 Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1848604831", "metadata": {"Type": "work"}}} Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:32:10.764504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1848604831', 'metadata': {'Type': 'work'}}}} Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise error Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi '0' Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:32:10.765314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 04:32:10.771019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 04:32:10.782364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 04:32:10.782364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.782364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2a86a6f6-09b4-40b0-8732-2a6e471b8661 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:32:10.782364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2a86a6f6-09b4-40b0-8732-2a6e471b8661 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010560 Oct 06 04:32:10.785314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Oct 6 04:32:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:32:10.795716 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e629728e-c923-4038-ac50-23b231a753c6 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Action: 'create', calling method: .version_select at 0x7f0c4393d310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1334609514", "metadata": {"Type": "work"}}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e629728e-c923-4038-ac50-23b231a753c6 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Request method failure captured: Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 119 Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpJT1W5J-czIObdRPp7daT1cScMH8l45ar9lhyt9sj0JZWkRV-7MXF0MySPJRZodCVVXQrKFL8o9qlZJ0b8sDUFgOhpugMzWnpGGYstjt_LKWp7gWmWJaOKPlHY5HDRj0tbj_uojMkOlDFdhsEoR3F8HT7bnVshGmbxJQE_wPAlVlM Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:32:10.804341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 06932e0595d442bdaa2f825384222551 Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1334609514", "metadata": {"Type": "work"}}} Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:32:10.805674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1334609514', 'metadata': {'Type': 'work'}}}} Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise error Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi '' Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:32:10.806572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 04:32:10.808994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 04:32:10.810152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 04:32:10.810152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:10.810152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e629728e-c923-4038-ac50-23b231a753c6 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:32:10.810152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e629728e-c923-4038-ac50-23b231a753c6 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019429 Oct 06 04:32:10.815999 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 3/3] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Oct 6 04:32:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:32:10.824399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9d4b9612-e15e-40cb-b1f4-d9108650f1fd tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Calling method '.version_select at 0x7f0c4393dd30>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:11.391475 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-9d4b9612-e15e-40cb-b1f4-d9108650f1fd tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] HTTP exception thrown: Volume tempest-invalid-1492462380 could not be found. Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9d4b9612-e15e-40cb-b1f4-d9108650f1fd tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Request method failure captured: Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1492462380 HTTP/1.1 Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpJT1W5J-czIObdRPp7daT1cScMH8l45ar9lhyt9sj0JZWkRV-7MXF0MySPJRZodCVVXQrKFL8o9qlZJ0b8sDUFgOhpugMzWnpGGYstjt_LKWp7gWmWJaOKPlHY5HDRj0tbj_uojMkOlDFdhsEoR3F8HT7bnVshGmbxJQE_wPAlVlM Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:32:11.400738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 06932e0595d442bdaa2f825384222551 Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Volume tempest-invalid-1492462380 could not be found. Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'tempest-invalid-1492462380'} Oct 06 04:32:11.403537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1492462380 could not be found. (HTTP 404) (Request-ID: req-8d99d947-5a6a-415e-8109-07fe8a6b899d) Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.404486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 04:32:11.405847 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1492462380 could not be found. Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:32:11.407084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1492462380 could not be found. Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1492462380 could not be found. Oct 06 04:32:11.408565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.411111 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9d4b9612-e15e-40cb-b1f4-d9108650f1fd tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Returning 404 to user: Volume tempest-invalid-1492462380 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:32:11.412477 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9d4b9612-e15e-40cb-b1f4-d9108650f1fd tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1492462380" status: 404 len: 99 microversion: 2.1 time: 0.594446 Oct 06 04:32:11.421427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Oct 6 04:32:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1492462380 => generated 99 bytes in 604 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 04:32:11.434453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5771e549-013f-430e-8b0f-2d66ab96b87f tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011453 Oct 06 04:32:11.435303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 5/5] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Oct 6 04:32:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 04:32:11.448975 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b0705433-eab1-4a6e-865c-1ecc89862ba6 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007468 Oct 06 04:32:11.457465 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1137 bytes} [Thu Oct 6 04:32:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 04:32:11.465862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2203ce53-b730-4c62-ba4a-15321be91477 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Calling method '.version_select at 0x7f0c438704c0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:11.571915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-2203ce53-b730-4c62-ba4a-15321be91477 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] HTTP exception thrown: Volume 9ee4e62a-c883-4b8c-9743-b760062e320f could not be found. Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2203ce53-b730-4c62-ba4a-15321be91477 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Request method failure captured: Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: DELETE /compute/v2.1/os-volumes/9ee4e62a-c883-4b8c-9743-b760062e320f HTTP/1.1 Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpJT1W5J-czIObdRPp7daT1cScMH8l45ar9lhyt9sj0JZWkRV-7MXF0MySPJRZodCVVXQrKFL8o9qlZJ0b8sDUFgOhpugMzWnpGGYstjt_LKWp7gWmWJaOKPlHY5HDRj0tbj_uojMkOlDFdhsEoR3F8HT7bnVshGmbxJQE_wPAlVlM Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:32:11.574901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 06932e0595d442bdaa2f825384222551 Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Volume 9ee4e62a-c883-4b8c-9743-b760062e320f could not be found. Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '9ee4e62a-c883-4b8c-9743-b760062e320f'} Oct 06 04:32:11.576357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ee4e62a-c883-4b8c-9743-b760062e320f could not be found. (HTTP 404) (Request-ID: req-f666a1d4-0484-4fbe-a498-d8458be66c1a) Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.577142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 04:32:11.578230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ee4e62a-c883-4b8c-9743-b760062e320f could not be found. Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 04:32:11.579398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ee4e62a-c883-4b8c-9743-b760062e320f could not be found. Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ee4e62a-c883-4b8c-9743-b760062e320f could not be found. Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2203ce53-b730-4c62-ba4a-15321be91477 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Returning 404 to user: Volume 9ee4e62a-c883-4b8c-9743-b760062e320f could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2203ce53-b730-4c62-ba4a-15321be91477 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/9ee4e62a-c883-4b8c-9743-b760062e320f" status: 404 len: 109 microversion: 2.1 time: 0.117674 Oct 06 04:32:11.580476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 7/7] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:32:11 2022] DELETE /compute/v2.1/os-volumes/9ee4e62a-c883-4b8c-9743-b760062e320f => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:32:11.594918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-47a7e25d-f05d-40f0-a51e-3b17bb2c9b58 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Calling method '.version_select at 0x7f0c438701f0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:11.614841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7a5eb232-f1ef-46f5-a063-e1f495746a7e tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.497967 Oct 06 04:32:11.626890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 1/8] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Oct 6 04:32:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3501 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 06 04:32:11.632567 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b771e350-2f97-4a2c-85ec-0414e54d4971 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Calling method '.version_select at 0x7f0c439543a0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:11.647802 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-47a7e25d-f05d-40f0-a51e-3b17bb2c9b58 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] HTTP exception thrown: Volume 9990bbc6-f03f-4fa2-bfd0-6131346461e1 could not be found. Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-47a7e25d-f05d-40f0-a51e-3b17bb2c9b58 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Request method failure captured: Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/os-volumes/9990bbc6-f03f-4fa2-bfd0-6131346461e1 HTTP/1.1 Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpJT1W5J-czIObdRPp7daT1cScMH8l45ar9lhyt9sj0JZWkRV-7MXF0MySPJRZodCVVXQrKFL8o9qlZJ0b8sDUFgOhpugMzWnpGGYstjt_LKWp7gWmWJaOKPlHY5HDRj0tbj_uojMkOlDFdhsEoR3F8HT7bnVshGmbxJQE_wPAlVlM Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:32:11.649754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd2a81810fcb4a11abc110f5e90052d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: bd2a81810fcb4a11abc110f5e90052d4 Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesNegativeTest-559266890 Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 06932e0595d442bdaa2f825384222551 Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesNegativeTest-559266890-project Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Volume 9990bbc6-f03f-4fa2-bfd0-6131346461e1 could not be found. Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '9990bbc6-f03f-4fa2-bfd0-6131346461e1'} Oct 06 04:32:11.651421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9990bbc6-f03f-4fa2-bfd0-6131346461e1 could not be found. (HTTP 404) (Request-ID: req-1e5e2174-4995-4f77-aeea-562c36811845) Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.652268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:32:11.653701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9990bbc6-f03f-4fa2-bfd0-6131346461e1 could not be found. Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 04:32:11.654902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9990bbc6-f03f-4fa2-bfd0-6131346461e1 could not be found. Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9990bbc6-f03f-4fa2-bfd0-6131346461e1 could not be found. Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-47a7e25d-f05d-40f0-a51e-3b17bb2c9b58 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] Returning 404 to user: Volume 9990bbc6-f03f-4fa2-bfd0-6131346461e1 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:32:11.656204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-47a7e25d-f05d-40f0-a51e-3b17bb2c9b58 tempest-VolumesNegativeTest-559266890 tempest-VolumesNegativeTest-559266890-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9990bbc6-f03f-4fa2-bfd0-6131346461e1" status: 404 len: 109 microversion: 2.1 time: 0.068507 Oct 06 04:32:11.660893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 8/9] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:32:11 2022] GET /compute/v2.1/os-volumes/9990bbc6-f03f-4fa2-bfd0-6131346461e1 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:32:11.770208 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b771e350-2f97-4a2c-85ec-0414e54d4971 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef" status: 200 len: 353 microversion: 2.1 time: 0.142757 Oct 06 04:32:11.775469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 2/10] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:32:11 2022] GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:32:12.785690 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0e2e4537-8e1f-44bd-a7cd-595e39e5dd0f tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Calling method '.version_select at 0x7f0c439403a0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:12.945067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0e2e4537-8e1f-44bd-a7cd-595e39e5dd0f tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef" status: 200 len: 353 microversion: 2.1 time: 0.164675 Oct 06 04:32:12.945901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 9/11] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:32:12 2022] GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:32:13.960776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-80b20947-514c-461c-bd13-f1bb120c4d71 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Calling method '.version_select at 0x7f0c43954a60>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:14.046891 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-80b20947-514c-461c-bd13-f1bb120c4d71 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef" status: 200 len: 354 microversion: 2.1 time: 0.089974 Oct 06 04:32:14.048018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 3/12] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:32:13 2022] GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:32:14.063799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5008bc53-00e5-41be-88ca-a12126aaea17 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Calling method '.version_select at 0x7f0c43870b80>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:14.125985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5008bc53-00e5-41be-88ca-a12126aaea17 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef" status: 200 len: 354 microversion: 2.1 time: 0.067027 Oct 06 04:32:14.126583 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 10/13] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:32:14 2022] GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:32:14.148307 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-963de837-24c5-43ae-8bf8-579c95d1a5c6 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Calling method '.version_select at 0x7f0c438ee160>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:14.251422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-963de837-24c5-43ae-8bf8-579c95d1a5c6 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef" status: 202 len: 0 microversion: 2.1 time: 0.109023 Oct 06 04:32:14.252347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 4/14] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:32:14 2022] DELETE /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:32:14.261111 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-92a362d7-f555-434a-bf29-3bc606fc8114 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Calling method '.version_select at 0x7f0c438703a0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:14.331250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-92a362d7-f555-434a-bf29-3bc606fc8114 tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef" status: 200 len: 353 microversion: 2.1 time: 0.074340 Oct 06 04:32:14.333282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 11/15] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:32:14 2022] GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:32:15.348619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-acd67898-7cf2-4449-9df9-2759bcc436ff tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Calling method '.version_select at 0x7f0c43954b80>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:15.413471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-acd67898-7cf2-4449-9df9-2759bcc436ff tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] HTTP exception thrown: Volume 3d921cea-0902-4a2f-900d-7f6661cf95ef could not be found. Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-acd67898-7cf2-4449-9df9-2759bcc436ff tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Request method failure captured: Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef HTTP/1.1 Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpIekF87DWbvleELsvH9FiiFeIN-aAo2BYHOAfHS1XVitbfm-4_OgJoJK1bI00yFxm3jHhD6PyT5wnP13HqixEwSDwe-jSNsVuS2cirYPsEvyDAenUxoXq7rFE_hJRCaKsLBprNhNIapczofSX3U6FbfdY7-vMWoiYpuCdygVceudc Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 0b73eb6e32754817806e3b97b0d1b402 Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-VolumesGetTestJSON-2040156024 Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:32:15.420340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b73eb6e32754817806e3b97b0d1b402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b73eb6e32754817806e3b97b0d1b402"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b73eb6e32754817806e3b97b0d1b402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b73eb6e32754817806e3b97b0d1b402"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-VolumesGetTestJSON-2040156024 Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 0b73eb6e32754817806e3b97b0d1b402 Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-VolumesGetTestJSON-2040156024 Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-VolumesGetTestJSON-2040156024-project Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: 2c6627dc1a8c4a7197c3a1d3f75decc5 Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-VolumesGetTestJSON-2040156024-project Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Volume 3d921cea-0902-4a2f-900d-7f6661cf95ef could not be found. Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '3d921cea-0902-4a2f-900d-7f6661cf95ef'} Oct 06 04:32:15.421953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3d921cea-0902-4a2f-900d-7f6661cf95ef could not be found. (HTTP 404) (Request-ID: req-9c6d1610-7f30-46b3-9922-d1e08da93719) Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:15.422843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:32:15.424023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3d921cea-0902-4a2f-900d-7f6661cf95ef could not be found. Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 04:32:15.425119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3d921cea-0902-4a2f-900d-7f6661cf95ef could not be found. Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3d921cea-0902-4a2f-900d-7f6661cf95ef could not be found. Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-acd67898-7cf2-4449-9df9-2759bcc436ff tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] Returning 404 to user: Volume 3d921cea-0902-4a2f-900d-7f6661cf95ef could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:32:15.426265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-acd67898-7cf2-4449-9df9-2759bcc436ff tempest-VolumesGetTestJSON-2040156024 tempest-VolumesGetTestJSON-2040156024-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef" status: 404 len: 109 microversion: 2.1 time: 0.078137 Oct 06 04:32:15.427355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 5/16] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:32:15 2022] GET /compute/v2.1/os-volumes/3d921cea-0902-4a2f-900d-7f6661cf95ef => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:32:24.954866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-21d7fcda-651a-4a94-9602-711e4c59b10d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'create', calling method: .version_select at 0x7f0c438709d0>, body: {"keypair": {"name": "tempest-keypair-1561560247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFnkkPnpi4Av7Er+AH7NxxFOLjpMr8AsSzcpDV9QLU+GQxvX9vq2VEbkbxOvXeiM5C4yRNCEik33PQYjosBmVrAzZ2SLiNUOApvdZjiWuDfvtIOEcRfMS72CgHb6lunOA=="}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:25.101702 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-21d7fcda-651a-4a94-9602-711e4c59b10d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Getting quotas for project f53abe2cc7a94ddaadb68b26b57faf69. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:25.118698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-21d7fcda-651a-4a94-9602-711e4c59b10d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Getting quotas for user 56c86f73f98a4fb2af787534fd47e2ed and project f53abe2cc7a94ddaadb68b26b57faf69. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:25.253396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-21d7fcda-651a-4a94-9602-711e4c59b10d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.640503 Oct 06 04:32:25.254621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 12/17] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:32:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:32:26.517149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-954d52f8-e92e-4cc8-9a0d-e1b7dcd96c44 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'create', calling method: .version_select at 0x7f0c442b09d0>, body: {"keypair": {"name": "tempest-keypair-1030917819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuNak1X8liYOu1ilDp8JP+TS7OOL898stfwV4bEAGEKvGs73kLgKLzqRHAlHKWP4mmXPii/cdW947ieq1JxKLzcbXMtRwdz2+NBo4DSGHzKw4FnffhU4d+tAsKa+euGqQ=="}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:26.706560 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-954d52f8-e92e-4cc8-9a0d-e1b7dcd96c44 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Getting quotas for project 594a13a702cf47898a48ab4fd6789359. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:26.720120 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-954d52f8-e92e-4cc8-9a0d-e1b7dcd96c44 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Getting quotas for user d574235b791e485aa64130c599539945 and project 594a13a702cf47898a48ab4fd6789359. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:26.805395 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-954d52f8-e92e-4cc8-9a0d-e1b7dcd96c44 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.019195 Oct 06 04:32:26.810879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 6/18] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Oct 6 04:32:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1026 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 04:32:27.380453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-434d1a76-9977-4266-a808-c4e0033579d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: .version_select at 0x7f0c43829280>, body: {"keypair": {"name": "tempest-keypair-50069608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTF99+EmCoxgiHP+JbkNfWvlWzyM/gxRPfPnMf1kTX7LXWeBJBOO6CeriY/hVCw1o/nKxaue0YvV35CCFJIm3H0B10S2/fv+0J/idFCao/a1O71ntH3gRjcFHESYwCFOQ=="}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:27.418755 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-882583481", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "networks": [{"uuid": "97b8f3be-2662-4f10-9b78-aa77c932c5e7"}]}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:27.424151 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-434d1a76-9977-4266-a808-c4e0033579d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:27.436713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-434d1a76-9977-4266-a808-c4e0033579d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for user f68d73b5efc74b3380429cf72e506905 and project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:27.497178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-434d1a76-9977-4266-a808-c4e0033579d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.415283 Oct 06 04:32:27.498845 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 7/19] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:32:27 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:32:27.685211 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] validate_networks() for [('97b8f3be-2662-4f10-9b78-aa77c932c5e7', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:32:30.152396 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1283443092", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:30.322975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] validate_networks() for [('2378409d-c551-4beb-a9cb-3e077e46deec', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:32:30.837457 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:32:30.838009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:32:30.838412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:32:30.838867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:32:30.839910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:32:30.865208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:30.866684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:30.867649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:30.871201 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:30.874362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:30.875648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:30.942609 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Getting quotas for project 93b9baf342f94f34ae8f649db7198137. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:30.955415 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Getting quotas for user 4f29428b32454dbdb9c644759389abec and project 93b9baf342f94f34ae8f649db7198137. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:30.982498 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:32:30.989073 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:32:31.190762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-166dcefc-e3fa-4634-bb64-72c49294d768 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.204589 Oct 06 04:32:31.191903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 13/20] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:32:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:32:31.208451 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6e8f8548-be2d-4a55-b620-2c23942b5d4d tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:31.209350 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6e8f8548-be2d-4a55-b620-2c23942b5d4d tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:31.446450 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6e8f8548-be2d-4a55-b620-2c23942b5d4d tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:31.476633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6e8f8548-be2d-4a55-b620-2c23942b5d4d tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1214 microversion: 2.1 time: 0.274278 Oct 06 04:32:31.477229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 14/21] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:31 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:32.503565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7eb0b1b3-50ad-41f0-b866-2491a56f992b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:32.504933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7eb0b1b3-50ad-41f0-b866-2491a56f992b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:32.669410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7eb0b1b3-50ad-41f0-b866-2491a56f992b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:32.681009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7eb0b1b3-50ad-41f0-b866-2491a56f992b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1214 microversion: 2.1 time: 0.181434 Oct 06 04:32:32.702704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 15/22] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:32 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:33.276632 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2137104911", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45c9d327-544f-44d6-be7e-529008b00a93"}], "security_groups": [{"name": "tempest-securitygroup--212314863"}], "key_name": "tempest-keypair-50069608", "user_data": "}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:33.611807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] validate_networks() for [('45c9d327-544f-44d6-be7e-529008b00a93', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:32:34.102558 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:32:34.104515 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:32:34.105222 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:32:34.105884 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:32:34.106503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:32:34.174898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:34.176662 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:34.177376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:34.179054 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:34.180044 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:34.180746 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:34.276126 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Getting quotas for project 0d643fb7b9314f0a9bb8f2c37f06bb2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:34.283980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Getting quotas for user a58cd041c02d46dcb8acf6adb11ee9de and project 0d643fb7b9314f0a9bb8f2c37f06bb2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:34.300545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:32:34.306616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:32:34.467717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e098d441-9e04-4613-9220-137542652e4c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.949622 Oct 06 04:32:34.475673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 8/23] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:32:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 4958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:32:34.486874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:34.487917 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:34.524677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:34.526733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:34.526733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:34.527627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:34.528050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:34.528420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:35.122399 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:35.202036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9ac6e26f-3262-4268-8111-7081e3e69d33 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1266 microversion: 2.1 time: 0.708244 Oct 06 04:32:35.202976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 9/24] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:34 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1266 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:35.260104 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-490207134", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dda97116-7fb3-4466-b2df-d492cd1f2494"}], "security_groups": [{"name": "tempest-securitygroup--2074118865"}], "key_name": "tempest-keypair-1561560247", "user_data": "}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:35.527536 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:32:35.528738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:32:35.529768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:32:35.530322 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:32:35.531625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:32:35.553280 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:35.554186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:35.555204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:35.563320 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:35.565001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:35.566130 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:35.613340 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:35.622830 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for user f68d73b5efc74b3380429cf72e506905 and project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:35.664139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:32:35.668555 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:32:35.741454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] validate_networks() for [('dda97116-7fb3-4466-b2df-d492cd1f2494', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:32:35.767506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1795fe32-275d-40c7-b035-72cf301bbb31 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.495818 Oct 06 04:32:35.769329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 16/25] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:32:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:32:35.774770 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-63919a8d-adc6-4915-a357-e3061cd9b06b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:35.775869 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-63919a8d-adc6-4915-a357-e3061cd9b06b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:35.985762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-63919a8d-adc6-4915-a357-e3061cd9b06b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:35.995832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-63919a8d-adc6-4915-a357-e3061cd9b06b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1222 microversion: 2.1 time: 0.225142 Oct 06 04:32:35.999129 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 17/26] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:35 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:36.015931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-582197865", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b586c8b5-56f0-4e30-8c9b-f6b5b9731066"}], "security_groups": [{"name": "tempest-securitygroup--287936601"}], "key_name": "tempest-keypair-1030917819", "user_data": "}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:36.175869 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] validate_networks() for [('b586c8b5-56f0-4e30-8c9b-f6b5b9731066', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:32:37.195088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:32:37.196221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:32:37.197449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:32:37.198700 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:32:37.199581 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:32:37.221956 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:37.225891 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:37.230592 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:37.233854 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:37.234952 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:37.235449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:37.318930 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:32:37.320082 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:32:37.321026 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:32:37.322397 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:32:37.323094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:32:37.338725 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:37.341575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:37.342360 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:37.345984 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:37.346706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:37.347232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Getting quotas for project 594a13a702cf47898a48ab4fd6789359. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:37.347658 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:37.366022 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Getting quotas for user d574235b791e485aa64130c599539945 and project 594a13a702cf47898a48ab4fd6789359. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:37.398910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:32:37.410513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:32:37.412097 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Getting quotas for project f53abe2cc7a94ddaadb68b26b57faf69. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:37.424669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Getting quotas for user 56c86f73f98a4fb2af787534fd47e2ed and project f53abe2cc7a94ddaadb68b26b57faf69. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:37.472815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:32:37.475902 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:32:37.538128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1058f3b6-a1d2-44f7-8aa0-8a37a096a494 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.537300 Oct 06 04:32:37.538789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 18/27] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Oct 6 04:32:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 04:32:37.555563 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:37.556890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:37.568443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:37.572178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:37.573247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:37.574057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:37.574545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:37.574967 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:37.741015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fa3faf66-6234-477f-baeb-d5f6d80d5e10 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.497165 Oct 06 04:32:37.753978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 10/28] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:32:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:32:37.753978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:37.753978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:37.807186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:37.809359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:37.809907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:37.812485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:37.813145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:37.817500 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:38.012655 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:38.039851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-dd5fd50f-4338-4b68-98be-9d16ae0f20a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1236 microversion: 2.1 time: 0.489700 Oct 06 04:32:38.046008 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 19/29] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:37 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1236 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:38.057253 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-263951759", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:38.261388 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] validate_networks() for [('2378409d-c551-4beb-a9cb-3e077e46deec', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:32:38.471589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:38.497032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8f26c64c-3404-4cae-a449-8b21d32699b0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1272 microversion: 2.1 time: 0.744566 Oct 06 04:32:38.502624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 11/30] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:37 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1272 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:38.525644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2d547fd9-c911-4dd0-abad-59f7929ebb4a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:38.527935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2d547fd9-c911-4dd0-abad-59f7929ebb4a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:39.449925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d547fd9-c911-4dd0-abad-59f7929ebb4a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:39.467376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d547fd9-c911-4dd0-abad-59f7929ebb4a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:39.470435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d547fd9-c911-4dd0-abad-59f7929ebb4a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:39.480967 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2d547fd9-c911-4dd0-abad-59f7929ebb4a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1281 microversion: 2.20 time: 0.976937 Oct 06 04:32:39.497665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 12/31] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:38 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1281 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:39.507871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:39.509066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:39.517063 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:39.517810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:39.518485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:39.519457 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:39.520135 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:39.520775 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:39.547929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:32:39.548510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:32:39.548814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:32:39.549345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:32:39.549615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:32:39.568740 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:39.569252 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:39.569700 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:39.572510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:39.573206 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:39.573703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:39.608566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Getting quotas for project 0d643fb7b9314f0a9bb8f2c37f06bb2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:32:39.613340 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Getting quotas for user a58cd041c02d46dcb8acf6adb11ee9de and project 0d643fb7b9314f0a9bb8f2c37f06bb2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:32:39.634893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:32:39.652167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:32:39.708865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:39.717597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-19d2722c-dcf9-49e4-bf47-97c8f3fadd08 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1241 microversion: 2.1 time: 0.218493 Oct 06 04:32:39.724860 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 13/32] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:39 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1241 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:39.750680 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:39.751734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:39.778693 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:39.785850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:39.786806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:39.788315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:39.791634 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:39.794609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:39.819787 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0df7763a-d1dd-4720-82fe-d33c18a45e69 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.772585 Oct 06 04:32:39.820765 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 20/33] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:32:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:32:39.864133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:39.864769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:39.889679 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:39.890181 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:39.890626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:39.891455 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:39.891833 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:39.892442 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:39.989132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:40.000863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d87afee9-5e33-4fd2-9030-8c835e1dda93 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1292 microversion: 2.1 time: 0.263143 Oct 06 04:32:40.003623 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 14/34] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:39 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1292 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:40.027163 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3955540d-ac1e-48b7-9061-a6a5032fd5b5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:40.033416 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3955540d-ac1e-48b7-9061-a6a5032fd5b5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:40.191029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:40.199448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3955540d-ac1e-48b7-9061-a6a5032fd5b5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:40.214536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3955540d-ac1e-48b7-9061-a6a5032fd5b5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1221 microversion: 2.1 time: 0.205970 Oct 06 04:32:40.215184 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-48e05ce7-e271-4ac7-9f16-7c9fb1a3cb41 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.390713 Oct 06 04:32:40.217384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 15/35] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:40 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1221 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:40.217979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 21/36] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:39 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:40.511838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:40.512825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:40.529467 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:40.530054 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:40.532243 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:40.533082 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:40.534698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:40.536558 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:40.627209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:40.635875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:40.637499 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:40.638635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0e6b3092-4cad-4e00-844d-bc09a18ac1ef tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1285 microversion: 2.20 time: 0.132375 Oct 06 04:32:40.657701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 16/37] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:40 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:40.751698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:40.752711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:40.762242 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:40.764190 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:40.764860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:40.765694 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:40.766360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:40.766920 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:40.884503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:40.898396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bca80509-b941-44f3-a442-b60e81e2f8dc tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1241 microversion: 2.1 time: 0.150942 Oct 06 04:32:40.899909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 22/38] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:40 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:41.033753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:41.034314 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:41.051213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.052004 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.052671 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.054020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.056778 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.059905 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.182715 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:41.193327 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-43fd8130-6573-4d71-b4da-c75119bfaa10 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1292 microversion: 2.1 time: 0.168533 Oct 06 04:32:41.215990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 17/39] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:41 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:41.243249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:41.245819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:41.247068 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:41.250907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:41.260198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:41.260956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.262718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.263612 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.264244 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.265210 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.266059 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.271150 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.272052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.273015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.273680 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.277369 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.277857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.400795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:41.422539 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6d4b4d51-ac63-42fc-ab46-2e46a9b65573 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1225 microversion: 2.1 time: 0.186977 Oct 06 04:32:41.438341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 23/40] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:41 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1225 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:41.484252 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:41.496987 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-99751f63-1710-4af1-a919-a803b12c3956 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.260510 Oct 06 04:32:41.498820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 18/41] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:41 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:41.667969 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:41.668855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:41.676437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.679529 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.681261 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.685015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.685730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.687232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.820809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:41.839224 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:41.840699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:41.841835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-dbb5d429-bf0e-4065-bae4-cc04db455fb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1285 microversion: 2.20 time: 0.181164 Oct 06 04:32:41.842710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 24/42] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:41 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:41.923089 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:41.923888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:41.935002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.935531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.937474 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:41.938603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:41.941033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:41.941935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:42.120830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:42.133568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3099ff5e-b38d-46a5-a7d9-00133df3d462 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1241 microversion: 2.1 time: 0.214778 Oct 06 04:32:42.147094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 19/43] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:41 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:42.223985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:42.225388 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:42.238675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:42.239429 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:42.240078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:42.241087 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:42.241916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:42.242768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:42.382379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:42.393979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8e236066-084a-4e26-8c5c-4efadde8995c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1292 microversion: 2.1 time: 0.174875 Oct 06 04:32:42.401120 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 25/44] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:42 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1292 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:42.448115 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:42.449490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:42.456859 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:42.457349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:42.457967 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:42.458673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:42.459380 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:42.459975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:42.521607 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:42.522382 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:42.535135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:42.535821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:42.536523 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:42.537452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:42.538146 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:42.538776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:42.597409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:42.605886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d7cbc4ce-27d1-4415-8a12-e0ab3b0f0d5a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1225 microversion: 2.1 time: 0.162418 Oct 06 04:32:42.609017 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 20/45] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:42 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:42.870441 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:42.873787 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:42.875708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:42.883416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-316a78e1-2ce2-40df-9837-b7c165161cd5 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.365533 Oct 06 04:32:42.889766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 26/46] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:42 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:42.909440 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:42.911478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:42.912006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:42.913982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:42.916583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:42.917409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:43.083650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:43.098043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:43.100406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:43.102070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d1a4fd7c-dc22-4e45-9999-827c086ba4ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1285 microversion: 2.20 time: 0.236098 Oct 06 04:32:43.103406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 21/47] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:42 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:32:43.174490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:43.175364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:43.190245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:43.190767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:43.191241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:43.191966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:43.192421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:43.199401 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:43.371698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:43.383062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-29830f86-6b48-4a98-b3dc-2e6ceb5f0b9f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1241 microversion: 2.1 time: 0.213799 Oct 06 04:32:43.384383 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 27/48] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:43 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:43.426908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:43.427772 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:43.443194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:43.443861 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:43.444422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:43.445275 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:43.445856 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:43.447480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:43.632752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:43.633379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:43.656333 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:43.656933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:43.658781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:43.666143 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:43.671657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5f28e385-ffde-4a15-aaa7-358e110147c0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1292 microversion: 2.1 time: 0.250829 Oct 06 04:32:43.673110 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:43.673235 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 22/49] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:43 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1292 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:43.678168 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:43.678620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:43.920602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:43.921537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:43.939011 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:43.941821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:43.944162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:43.947775 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:43.948294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:43.948669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:44.349546 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:44.369690 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2ed6c161-df08-4ad1-b7bc-a095aabe250b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1225 microversion: 2.1 time: 0.739947 Oct 06 04:32:44.391435 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 28/50] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:43 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1225 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:44.402676 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:44.403450 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:44.422341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:44.422842 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:44.423306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:44.424044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:44.427588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:44.428215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:44.529117 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:44.546859 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-998c652a-7579-42e3-98df-bfa44a97023e tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.624825 Oct 06 04:32:44.565549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 23/51] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:43 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:44.578648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:44.587148 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:44.604988 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:44.605557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:44.606053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:44.606735 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:44.607409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:44.607835 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:44.688044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:44.700107 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:44.701571 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:44.702693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c3205ab0-d4a6-4c06-812c-f007fa4c7b47 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.309390 Oct 06 04:32:44.727483 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 29/52] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:44 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:44.739515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:44.740138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:44.754799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:44.797670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:44.797670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:44.797670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:44.797670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:44.798004 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:45.037052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:45.048420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fc1e0ff4-c504-4b50-9ff1-080b3328ee16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1292 microversion: 2.1 time: 0.318915 Oct 06 04:32:45.064244 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 30/53] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:44 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1292 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:45.285506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:45.303900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3b54bd8f-79b3-4779-978e-d7855a42c899 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.736855 Oct 06 04:32:45.314475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 24/54] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:44 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:45.393306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:45.393939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:45.414725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:45.415832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:45.416326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:45.417167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:45.417618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:45.418045 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:45.571285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:45.573092 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:45.584883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:45.585665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:45.586249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:45.588076 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:45.588976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:45.589555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:46.031049 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:46.040124 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ad8fd04c-1754-4dc8-9f6a-5db62757195b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.650408 Oct 06 04:32:46.065479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 31/55] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:45 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:46.074347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:46.087019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:46.099102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:46.119317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:46.125397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:46.129711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:46.136356 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:46.138926 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:46.300006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:46.311999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-19f3af56-63e1-4bf1-8f29-4ea742a0b2da tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.745166 Oct 06 04:32:46.312810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 25/56] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:45 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:46.322785 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:46.323823 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:46.335072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:46.339524 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:46.342038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:46.344868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:46.345592 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:46.346206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:46.449759 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:46.475828 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:46.484795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:46.490417 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2249a9c6-0213-46f6-9d00-01571bca8169 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.423266 Oct 06 04:32:46.495293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 32/57] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:46 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:46.504628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:46.507735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:46.517960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:46.522282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:46.522899 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:46.524032 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:46.526076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:46.526949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:46.658538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:46.673572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-78606448-2d69-4e40-ad4b-1199bad66642 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.177033 Oct 06 04:32:46.676105 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 33/58] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:46 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:46.702043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:46.716013 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-345fdf16-a0c7-483a-bab1-8180374ea00d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.399676 Oct 06 04:32:46.716849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 26/59] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:46 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:47.073085 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:47.073699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:47.079598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.080096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.080531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.081241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.081813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.082088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.154340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-ddd636d1-19a2-4781-aee8-86e0baab9a1a req-5f682031-5656-445a-a261-6dec798ab5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f70ee71-4e29-4e3b-8073-d006f525c847", "tag": "82231974-6803-4127-b9f5-c7ea01ea019f"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:32:47.161898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:47.171946 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ddd636d1-19a2-4781-aee8-86e0baab9a1a req-5f682031-5656-445a-a261-6dec798ab5b6 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.172508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ddd636d1-19a2-4781-aee8-86e0baab9a1a req-5f682031-5656-445a-a261-6dec798ab5b6 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.173002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ddd636d1-19a2-4781-aee8-86e0baab9a1a req-5f682031-5656-445a-a261-6dec798ab5b6 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.173191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0ffde954-8e8f-4a04-aedc-3a15643360c8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.104507 Oct 06 04:32:47.173775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 34/60] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:47 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:47.194089 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-ddd636d1-19a2-4781-aee8-86e0baab9a1a req-5f682031-5656-445a-a261-6dec798ab5b6 service nova] Creating event network-changed:82231974-6803-4127-b9f5-c7ea01ea019f for instance 4f70ee71-4e29-4e3b-8073-d006f525c847 on hv-cinder-86022 Oct 06 04:32:47.194611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ddd636d1-19a2-4781-aee8-86e0baab9a1a req-5f682031-5656-445a-a261-6dec798ab5b6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 04:32:47.195020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ddd636d1-19a2-4781-aee8-86e0baab9a1a req-5f682031-5656-445a-a261-6dec798ab5b6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 04:32:47.196074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.196555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.197046 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.197760 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.198209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.198632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.207013 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.compute.rpcapi [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 04:32:47.207872 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] Releasing lock "compute-rpcapi-router" {{(pid=127098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 04:32:47.224130 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6ab088a4-41c0-4421-a01e-5178c93d1be6 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135437 Oct 06 04:32:47.224733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 27/61] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:32:47.346576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:47.347208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:47.353705 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.354191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.354620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.355335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.355788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.356215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.360161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:47.493765 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:47.502259 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4354ab61-0d39-4d8b-8c6a-5f1abccbd96f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.159487 Oct 06 04:32:47.502832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 35/62] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:47 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:47.525816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:47.526523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:47.531883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:47.533879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.534647 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.535268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.536162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.536615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.537218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.543383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:47.604539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:47.614429 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:47.616322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:47.618269 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1561e85a-1ef8-4976-b8c1-490a190168f9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.104345 Oct 06 04:32:47.619068 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 28/63] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:47 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:47.702395 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:47.703711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:47.710033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.710593 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.711152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.712188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.713443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.713949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.741594 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:47.742294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:47.750832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.754392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.755132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.756051 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:47.756719 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:47.757331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:47.796269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:47.807263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f59418b5-773f-4fd9-8f78-f1d03e2e78ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.110481 Oct 06 04:32:47.807932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 36/64] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:47 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:47.823834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:47.831590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e5038c54-513f-43ab-9151-680402a4fd26 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.093893 Oct 06 04:32:47.832186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 29/65] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:47 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:48.201214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:48.202105 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:48.219518 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.220261 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.221648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.224089 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.225375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.232184 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.321298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:48.339569 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-754c07be-0491-4be0-becb-f3ed12ee5b20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.146006 Oct 06 04:32:48.343101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 37/66] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:48 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:48.530974 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:48.531762 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:48.537990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.538485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.538928 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.539719 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.540124 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.540798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.644609 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:48.645840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:48.663292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.663802 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.664245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.664962 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.665477 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.666150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.702279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:48.711034 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-60d955f4-6db1-4cde-8560-8e9026d7a57a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.183841 Oct 06 04:32:48.711636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 30/67] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:48 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:48.751617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:48.760533 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:48.762063 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:48.763336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5e0ed8fb-5c2d-4ae0-aae7-92bfd97f3e34 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.122789 Oct 06 04:32:48.764006 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 38/68] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:48 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:48.830996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:48.831605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:48.838577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.839107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.839561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.840268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.840725 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.841170 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.855553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:48.856167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:48.866928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.870406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.870860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.871617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:48.872146 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:48.872527 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:48.932615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:48.940303 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b3ae3938-00a1-4bf5-982b-57138134e7c4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.113059 Oct 06 04:32:48.941084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 31/69] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:48 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:48.958410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:48.966785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-56ea5241-0860-40a3-b3c4-af94592133db tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.115507 Oct 06 04:32:48.967389 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 39/70] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:48 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:49.364773 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:49.365413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:49.372609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:49.373172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:49.373605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:49.374379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:49.374876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:49.375372 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:49.442289 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:49.450878 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b50aaa7e-445d-4238-aa5d-a85e9b1d9041 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.089921 Oct 06 04:32:49.451551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 32/71] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:49 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:49.735077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:49.736027 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:49.737973 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=8 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:49.738710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=34 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:49.745803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:49.746288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:49.746725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:49.747457 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:49.747914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:49.748342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:49.788769 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:49.789382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:49.796561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:49.797050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:49.797497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:49.798207 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:49.798660 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:49.799176 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:49.875301 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:49.883859 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:49.886683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:49.888011 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e432baae-7401-4c07-b6aa-fc7aa910f8de tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.103162 Oct 06 04:32:49.888694 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 33/72] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:49 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:32:49.923906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:49.932531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ce54d31d-9643-45f1-aa0d-7dff98096f46 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.201858 Oct 06 04:32:49.933112 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 40/73] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:49 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:49.963964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:49.965141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:49.971677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:49.972569 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:49.973020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:49.974065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:49.974623 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:49.975148 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:49.990780 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:49.992898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:50.012092 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:50.012585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:50.013025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:50.013743 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:50.014208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:50.014634 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:50.060790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:50.070489 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-08eb636d-8fe7-48b1-a0ea-77419907c14a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.111148 Oct 06 04:32:50.074457 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 34/74] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:49 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:50.100772 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:50.114317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3ae6ccb4-44d6-4ef1-9651-a5805759af6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.127212 Oct 06 04:32:50.114902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 41/75] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:49 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:50.476597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:50.477121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:50.479642 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=24 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:50.485459 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:50.485937 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:50.486373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:50.487087 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:50.487537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:50.487955 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:50.551225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:50.560264 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c8fc904a-c8d6-4a02-8894-8ba8f8194ea7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.087325 Oct 06 04:32:50.561250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 35/76] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:50 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:50.918763 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:50.920043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:50.926317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:50.926789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:50.927249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:50.927942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:50.928394 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:50.928977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:50.956810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:50.958224 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:50.967464 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:50.968194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:50.968810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:50.969665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:50.970146 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:50.970677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:51.016926 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:51.025526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:51.027170 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:51.028499 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fbde24e7-222c-4c76-aa24-a5bc0c9150a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.115274 Oct 06 04:32:51.032152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 42/77] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:50 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:32:51.105187 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:51.106151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:51.124423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:51.125712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:51.127449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:51.128417 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:51.128885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:51.129321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:51.144605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:51.153384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-01b2e8a2-f3c6-4c47-9029-f160948ef011 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.200758 Oct 06 04:32:51.153993 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 36/78] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:50 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:51.166697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:51.166697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:51.174280 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:51.175192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:51.175984 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:51.176882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:51.177470 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:51.178037 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:51.246630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:51.254831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b1b64bab-fa4b-4e89-b57f-41c5128c33b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.154109 Oct 06 04:32:51.255754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 43/79] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:51 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:51.272209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:51.280936 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-bc753fd0-7bc2-408c-a7f5-d92c7535c03b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.125767 Oct 06 04:32:51.282200 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 37/80] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:51 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:51.584272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:51.584912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:51.590862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:51.591370 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:51.591803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:51.592490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:51.592942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:51.593361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:51.656028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:51.663545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3018e6cb-8530-41a4-a6fa-954e5281caf7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.083148 Oct 06 04:32:51.664101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 44/81] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:51 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:52.053626 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:52.054196 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:52.060684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.061171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.061607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.062302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.062759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.063225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.125312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:52.133265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:52.135233 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:52.136322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-db328d65-fcb5-4ba1-883c-dff1139ac29b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.086748 Oct 06 04:32:52.136880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 38/82] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:52 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:52.185490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:52.185490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:52.194531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.201410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.201910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.202723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.207997 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.209766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.280730 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:52.281355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:52.288346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.288842 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.289308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.290020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.291102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.291532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.359238 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:52.363667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:52.369698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-cfe7b48d-b8c2-4665-9a1b-72badac525b2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.092683 Oct 06 04:32:52.373740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 39/83] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:52 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:52.376069 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-16096208-4abd-48bd-b861-e6f594089067 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.197759 Oct 06 04:32:52.380863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:52.381923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 45/84] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:52 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:52.382681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:52.390322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.391046 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.391607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.392458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.393036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.393578 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.457186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:52.465132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3cd6a509-eed1-4138-9c6f-9f419404fe90 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.087982 Oct 06 04:32:52.465698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 40/85] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:52 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:52.688012 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:52.688720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:52.694602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.695121 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.695556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.696248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:52.697415 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:52.697839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:52.816009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:52.827977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fa980c48-c34f-4c42-a933-24178b42bdb2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.142787 Oct 06 04:32:52.847203 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 46/86] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:52 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:53.161749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:53.162415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:53.169067 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.169563 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.170073 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.170759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.171253 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.171681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.270208 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:53.279666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:53.282064 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:53.283457 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8771b5d8-5794-46c8-b909-4da4f893404b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.125919 Oct 06 04:32:53.284266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 41/87] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:53 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:53.401898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:53.402565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:53.405249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:53.406058 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:53.408689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.409187 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.409625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.410334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.410815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.411447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.417420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.417924 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.418366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.419121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.419583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.420037 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.520166 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:53.533213 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2b0cc117-759b-4e9f-9d0b-658643de8ae7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.135752 Oct 06 04:32:53.536218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 47/88] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:53 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:53.553154 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:53.555365 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:53.571303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.571303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.571303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.571303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.571767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.575479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.622402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:53.631348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0bf09601-d648-4aab-8aca-c09549dc1126 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.230608 Oct 06 04:32:53.632250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 42/89] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:53 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:53.680902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:53.689203 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0df60f61-fbff-4370-9818-c7018ca9d445 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.149260 Oct 06 04:32:53.689890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 48/90] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:53 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:53.854851 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:53.855515 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:53.861978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.862468 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.862912 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.863636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:53.864100 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:53.864529 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:53.944192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:53.960080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-683f18dc-e91f-4cc3-a58e-9ea2ff356edf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.109585 Oct 06 04:32:53.961354 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 43/91] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:53 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:54.309666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:54.310310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:54.316255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.316740 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.317181 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.317870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.318325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.318754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.380343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:54.388817 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:54.390253 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:54.391382 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c3dfae08-5ce6-407d-941d-637726770c6b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.086704 Oct 06 04:32:54.391939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 49/92] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:54 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:54.558998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:54.559613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:54.565546 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.566036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.566477 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.567239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.567701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.568127 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.644466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:54.650437 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:54.656631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-284efeed-a3e7-474d-8212-c970dfec3b4e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.102622 Oct 06 04:32:54.657920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 44/93] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:54 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:54.658978 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:54.660328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:54.667339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.668073 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.668715 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.669624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.670292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.671041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.714697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:54.715350 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:54.721823 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.722539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.723267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.724190 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.724824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.725430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.797625 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:54.807991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-88ddedac-3b0a-4925-890e-6932fc277d4e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.098016 Oct 06 04:32:54.808651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 45/94] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:54 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:54.831671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:54.840655 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8419c5e7-4990-4380-b2c9-06bc7d5f24cd tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.185908 Oct 06 04:32:54.841240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 50/95] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:54 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:54.989645 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:54.989645 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:54.994751 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.995273 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.995714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:54.996564 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:54.997112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:54.997570 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.065310 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:55.073107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-71147908-c399-4d33-b45c-0395c20a18bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.090854 Oct 06 04:32:55.073672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 46/96] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:54 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:55.417327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:55.417946 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:55.424474 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:55.424952 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:55.425386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.426073 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:55.426544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:55.426981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.496273 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:55.499691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:55.505204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:55.506661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:55.507780 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9c3ae544-cf17-4b4a-a0d7-b51abcdfdcec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.095296 Oct 06 04:32:55.508335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 51/97] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:55 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:55.682396 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:55.683062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:55.693540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:55.697909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:55.700659 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.702068 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:55.703374 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:55.704079 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.785267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:55.793386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e7580440-2d49-4a31-b517-5d4db09e7794 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.115944 Oct 06 04:32:55.793967 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 47/98] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:55 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:55.831158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:55.831839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:55.838120 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:55.838616 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:55.839103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.839796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:55.840266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:55.840674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.875441 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:55.876075 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:55.886170 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:55.886671 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:55.887320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.888191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:55.888854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:55.889431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:55.906683 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:55.918379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-52b53e64-4d0b-4fda-9c45-28356035b55b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.090966 Oct 06 04:32:55.919110 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 52/99] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:55 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:56.041961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:56.049804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-bc91fde7-f52a-4427-a41f-ad1238a264e3 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.182966 Oct 06 04:32:56.050377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 48/100] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:55 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:56.095964 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:56.096580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:56.102350 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:56.103599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:56.104131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:56.104832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:56.105290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:56.105716 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:56.180877 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:56.188632 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1945d25c-0dbd-4c92-b945-77f60f323eb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.096435 Oct 06 04:32:56.189196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 53/101] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:56 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:56.533584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:56.534439 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:56.540482 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:56.541006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:56.541523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:56.542213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:56.542698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:56.543176 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:56.604430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:56.612637 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:56.614102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:56.615220 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d39197f2-7bef-4635-aba8-e5fb10cdf856 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.085513 Oct 06 04:32:56.615776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 49/102] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:56 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:56.816387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:56.817229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:56.827936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:56.828423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:56.828857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:56.829749 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:56.830281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:56.830823 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:56.919756 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:56.927623 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e6c1ed01-d27a-4139-b7e9-4944908a7ce7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.115154 Oct 06 04:32:56.928184 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 54/103] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:56 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:56.945394 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:56.946000 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:56.952616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:56.953091 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:56.953519 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:56.954197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:56.954643 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:56.955162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:57.026564 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:57.034494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-73cc6682-1bfe-465c-addd-6757228b030b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.092802 Oct 06 04:32:57.035392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 50/104] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:56 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:57.074643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:57.075604 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:57.081813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:57.082397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:57.083108 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:57.083873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:57.084398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:57.085023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:57.215354 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:57.215973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:57.219071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:32:57.221987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:57.230135 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:57.234859 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d36d5a7e-e5d3-471f-85d2-ab0cafcc3207 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.165420 Oct 06 04:32:57.235733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:57.236373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:57.237110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:57.237557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:57.238324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 55/105] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:57 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:57.239184 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:57.318041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:57.326494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d3e5a0ae-da85-4eb0-b3d2-2a8537182fad tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.118643 Oct 06 04:32:57.327084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 51/106] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:57 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:57.640483 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:57.641049 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:57.647036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:57.647516 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:57.647939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:57.648625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:57.649068 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:57.649571 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:57.712444 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:57.726239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:57.726239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:57.726239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b7144acd-3c6e-44ae-bf4e-d00b90256caf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.088047 Oct 06 04:32:57.726522 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 56/107] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:57 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:57.951088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:57.951689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:57.958898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:57.959667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:57.960316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:57.961370 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:57.962302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:57.963035 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.034536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:58.043547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-356491c5-2ecb-4def-902f-b8cd9f578136 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.096133 Oct 06 04:32:58.058606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 52/108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:57 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:58.059386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:58.059386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:58.068929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:58.069424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:58.069851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.070560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:58.071034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:58.072060 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.151139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:58.159554 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ae115286-afae-44c0-91f5-c014df4bb096 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.105498 Oct 06 04:32:58.160329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 57/109] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:58 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:58.262268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:58.263183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:58.269401 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:58.269888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:58.270319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.271039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:58.271490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:58.271909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.350319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:58.351395 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:58.359139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:58.359566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:58.360001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.360760 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:58.361186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:58.361609 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.412345 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:58.421486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-234062a7-86ce-4862-97f6-b9fa00bc44c1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.162821 Oct 06 04:32:58.422317 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 53/110] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:58 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:58.438362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:58.448500 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-275cf746-967d-4bce-b689-54e4535cc4ab tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.102908 Oct 06 04:32:58.449082 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 58/111] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:58 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:32:58.757323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:58.757924 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:58.764252 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:58.764718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:58.765147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.765825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:58.766267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:58.766680 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:58.830613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:58.840230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:58.841847 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:58.843207 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8857577b-be7a-48b1-8816-87814d7ecb50 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.089757 Oct 06 04:32:58.843769 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 54/112] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:58 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:32:59.065957 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:59.066482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:59.072425 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.072902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.073358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.074043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.074489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.074906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.160650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:59.169806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-77383259-db1e-4cff-9565-1d43db3a5a4c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.107673 Oct 06 04:32:59.170424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 59/113] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:59 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:59.189464 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:59.195413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:59.214348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.218281 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.220284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.224383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.227172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.228289 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.331818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:59.340880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f96bf1cd-4bd7-4fab-b99c-978a02135c8e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.158939 Oct 06 04:32:59.341476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 55/114] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:59 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:59.445186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:59.445838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:59.452187 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.452710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.453580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.454309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.454763 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.455212 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.476215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:59.477189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:59.490393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.492926 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.493561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.495192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.495910 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.496585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.632511 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:59.642947 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-73bc8477-e3ee-40bb-8f57-be3cba8719a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1273 microversion: 2.1 time: 0.173341 Oct 06 04:32:59.643600 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 56/115] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:59 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:59.807578 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:32:59.818106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ba334ba6-1a76-4bdb-abf3-b1b0c5d36112 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.377222 Oct 06 04:32:59.818872 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 60/116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:32:59 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:32:59.872598 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:32:59.873482 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:32:59.879737 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.880155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.880587 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:32:59.881764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:32:59.882322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:32:59.882646 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.040606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:00.054841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:00.059938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:00.062278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-46397782-3fac-4647-a235-d3f5b9b01d49 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1277 microversion: 2.20 time: 0.195295 Oct 06 04:33:00.078638 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 57/117] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:32:59 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:00.197882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:00.198492 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:00.213668 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:00.214169 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:00.217207 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.220131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:00.221652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:00.230123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.365954 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:00.366751 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:00.376697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:00.377404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:00.377933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.378905 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:00.390770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:00.393909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.568750 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:00.577774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:00.578104 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-324db459-a7cb-43a7-aa15-a08dd2cc65f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1298 microversion: 2.1 time: 0.217196 Oct 06 04:33:00.579188 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 58/118] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:00 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1298 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:00.597397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1091887f-cf6d-4ebe-97a0-b3e7664fc378 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1233 microversion: 2.1 time: 0.403539 Oct 06 04:33:00.598083 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 61/119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:00 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1233 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:00.672405 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:00.673019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:00.698932 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:00.699462 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:00.699908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.700618 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:00.701072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:00.701503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.842940 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:00.843573 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:00.861273 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:00.862269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:00.866206 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.867407 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:00.868729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:00.869325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:00.895530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:00.918784 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8d49bb9e-25a1-422b-8de2-ae39f133a9b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1279 microversion: 2.1 time: 0.250139 Oct 06 04:33:00.919877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 59/120] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:00 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:01.090276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:01.091569 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:01.102885 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:01.103722 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:01.104422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:01.105365 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:01.106299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:01.106876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:01.349947 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:01.373531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:01.375335 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:01.381639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8e2d86da-ec08-4ef9-8011-ca8ed446132f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1341 microversion: 2.20 time: 0.295152 Oct 06 04:33:01.395066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 60/121] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:01 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1341 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:01.540606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-3cf5a8fb-1c7c-4e8d-8f52-1fd5a4c72d02 req-adf226da-cefb-4c37-96d9-37ee08a27179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1de82b-ccd4-4783-8f2b-8db183ab18ae", "tag": "32169a85-ede4-4200-8d87-9cc5853244e1"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:01.561560 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3cf5a8fb-1c7c-4e8d-8f52-1fd5a4c72d02 req-adf226da-cefb-4c37-96d9-37ee08a27179 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:01.564180 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3cf5a8fb-1c7c-4e8d-8f52-1fd5a4c72d02 req-adf226da-cefb-4c37-96d9-37ee08a27179 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:01.568494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3cf5a8fb-1c7c-4e8d-8f52-1fd5a4c72d02 req-adf226da-cefb-4c37-96d9-37ee08a27179 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:01.572245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:01.582231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-54f428d7-8126-45d4-b709-862f981fa90a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.745285 Oct 06 04:33:01.585301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 62/122] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:00 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:01.601787 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:01.602865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:01.615505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:01.615828 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-3cf5a8fb-1c7c-4e8d-8f52-1fd5a4c72d02 req-adf226da-cefb-4c37-96d9-37ee08a27179 service nova] Creating event network-changed:32169a85-ede4-4200-8d87-9cc5853244e1 for instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae on hv-cinder-86022 Oct 06 04:33:01.616624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:01.618515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:01.622930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:01.624181 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:01.626179 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:01.640978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-3cf5a8fb-1c7c-4e8d-8f52-1fd5a4c72d02 req-adf226da-cefb-4c37-96d9-37ee08a27179 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189143 Oct 06 04:33:01.641739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 61/123] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:33:01.657311 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:01.658223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:01.676097 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:01.676845 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:01.693183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:01.694071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:01.694556 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:01.695041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:01.733888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:01.947848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:01.951245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:01.968211 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f44084ee-b647-4be4-8f2a-84ab90c0f939 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.369381 Oct 06 04:33:01.968833 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 63/124] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:01 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:01.973321 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-74ee7e2b-37e7-494a-a67e-ffd2e8f71647 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1289 microversion: 2.1 time: 0.330537 Oct 06 04:33:01.975557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 62/125] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:01 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1289 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:01.977861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:01.978610 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:01.987399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:01.990079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:01.993385 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:01.998650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:02.000399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:02.001831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:02.409345 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:02.413409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:02.426699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:02.427750 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:02.428555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:02.429571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:02.430530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:02.431274 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:02.549195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:02.558863 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a2246c8e-2eb0-4c49-8f9f-d83c39fbd772 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.589005 Oct 06 04:33:02.559829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 64/126] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:01 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:02.580965 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:02.604193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:02.611839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:02.613041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:02.615199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-71b390d5-dfee-4cab-8857-33bc050dc556 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1339 microversion: 2.20 time: 0.209890 Oct 06 04:33:02.615798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 63/127] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:02 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:02.622145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:02.630357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:02.631166 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:02.631751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:02.632733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:02.633338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:02.634553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:02.964066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:02.978335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7c2ab8e7-a9d3-4a99-b52f-dcb843ac11bc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.370059 Oct 06 04:33:02.980454 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 65/128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:02 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:03.001105 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:03.001875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:03.011312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:03.012813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.013227 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:03.013468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.016487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.017302 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.018241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.018988 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.021165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.021931 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.022525 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.024446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.025306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.026103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.132352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:03.145079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-314656ee-57d0-4282-b53e-e27d790d6cf9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.147521 Oct 06 04:33:03.146086 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 66/129] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:02 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:03.203146 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:03.211236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-62ccd6f0-98c7-4885-ab59-059e484283c7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.215137 Oct 06 04:33:03.219346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 64/130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:02 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:03.587563 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:03.588335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:03.594773 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.595291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.595725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.596420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.596870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.597329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.641692 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:03.642461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:03.648683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.649188 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.650547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.651596 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.652749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.653640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.752218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:03.761080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-61cbe74d-1dbd-4cc8-8c5a-81fc3469d859 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.177670 Oct 06 04:33:03.768478 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 67/131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:03 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:03.772636 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-786a1603-cdec-415c-acdd-1fe57adfd3c6 req-f48b33a3-e17d-410f-8bde-80b087094d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba369ba5-73dc-42d2-a375-b15b0e42188c", "tag": "6388b760-70f1-47b6-a577-dd35569e080b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:03.786939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-786a1603-cdec-415c-acdd-1fe57adfd3c6 req-f48b33a3-e17d-410f-8bde-80b087094d87 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.787543 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-786a1603-cdec-415c-acdd-1fe57adfd3c6 req-f48b33a3-e17d-410f-8bde-80b087094d87 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.788051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-786a1603-cdec-415c-acdd-1fe57adfd3c6 req-f48b33a3-e17d-410f-8bde-80b087094d87 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.803461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:03.812796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:03.814525 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:03.814812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-786a1603-cdec-415c-acdd-1fe57adfd3c6 req-f48b33a3-e17d-410f-8bde-80b087094d87 service nova] Creating event network-changed:6388b760-70f1-47b6-a577-dd35569e080b for instance ba369ba5-73dc-42d2-a375-b15b0e42188c on hv-cinder-86022 Oct 06 04:33:03.815434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-786a1603-cdec-415c-acdd-1fe57adfd3c6 req-f48b33a3-e17d-410f-8bde-80b087094d87 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 04:33:03.815870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-34687d12-3d18-49bb-9cc0-b9884eca78cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.178096 Oct 06 04:33:03.815995 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-786a1603-cdec-415c-acdd-1fe57adfd3c6 req-f48b33a3-e17d-410f-8bde-80b087094d87 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 04:33:03.816876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 65/132] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:03 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:03.817060 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.817517 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.818026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.818715 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:03.819197 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:03.819773 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:03.827699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:03.830793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.compute.rpcapi [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 04:33:03.831778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] Releasing lock "compute-rpcapi-router" {{(pid=127097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 04:33:03.846478 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-284ebaef-ac78-42dd-817b-e5b260eee6a4 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083241 Oct 06 04:33:03.847438 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 68/133] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:04.012649 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:04.013330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:04.019378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.019949 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.020446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.021205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.021747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.022234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.159298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:04.169559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c7c84365-1090-42b4-9b92-6c162d78f8b7 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.161491 Oct 06 04:33:04.170508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 66/134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:04 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:04.171391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:04.172156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:04.179237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.179903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.180502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.182326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.183341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.183924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.234617 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:04.235239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:04.241577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.242071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.242758 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.243521 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.243970 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.244393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.273985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:04.283533 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c0ee7c0c-b47d-4701-acfa-7b0cc37618f4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.116480 Oct 06 04:33:04.284300 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 69/135] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:04 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:04.389161 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:04.397111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0f8b2ec6-41fb-4640-9653-70b4b9bfdef1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.166299 Oct 06 04:33:04.410951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 67/136] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:04 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:04.785177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:04.785795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:04.792296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.792779 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.793215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.793940 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.794392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.794813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.841617 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:04.842321 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:04.848478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.849034 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.849532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.850291 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:04.850807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:04.851328 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:04.948802 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:04.971335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9a48e7fe-4ddb-4fb0-a2c3-ccbbefd0c66d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.189646 Oct 06 04:33:04.971959 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 70/137] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:04 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:05.020527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:05.030754 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:05.032316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:05.033421 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3830369d-0cfb-486d-b5ae-0e95d09662f4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.195707 Oct 06 04:33:05.033998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 68/138] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:04 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:05.196657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:05.197391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:05.203390 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:05.203882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:05.204312 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:05.205009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:05.205462 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:05.205884 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:05.308383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:05.308997 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:05.314906 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:05.315421 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:05.315859 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:05.316620 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:05.317075 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:05.317499 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:05.388415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:05.400129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1cc5b9f8-463b-4a11-b78c-ce005ef1e4bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.094933 Oct 06 04:33:05.401023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 69/139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:05 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:05.420749 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:05.422521 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:05.423157 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:05.427835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-32572ee7-f211-415c-a157-20511df493a0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.235132 Oct 06 04:33:05.428426 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 71/140] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:05 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:05.429515 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:05.430148 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:05.430930 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:05.431985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:05.432588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:05.433014 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:05.577735 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:05.589002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0d02d7e3-49a0-4dc8-9a8f-dfde0173f03a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.171037 Oct 06 04:33:05.589679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 70/141] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:05 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:05.996566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:05.997082 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:06.003836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.004323 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.004817 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.007788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.007788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.007788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.058152 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:06.059554 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:06.067591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.068431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.069128 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.070147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.071259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.072133 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.147395 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:06.156109 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-189ef09e-e783-4b52-98d7-425fc2bb299b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.164248 Oct 06 04:33:06.157297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 72/142] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:05 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:06.215156 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:06.222455 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:06.229646 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:06.230936 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-23065d6c-65fc-4ee7-b42f-bbb6ef4f56e5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.177034 Oct 06 04:33:06.231585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 71/143] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:06 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:06.423367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:06.424077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:06.429159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:06.433457 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.433956 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.434397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.435140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.435604 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.436063 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.453657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:06.454832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:06.468096 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.468599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.469033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.469769 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.470222 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.470650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.509979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:06.517801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bead27b3-218d-4ea5-a0c5-d0baf91b7bb1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.098088 Oct 06 04:33:06.518574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 73/144] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:06 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:06.613546 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:06.613546 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:06.620120 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.620726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.621304 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.622107 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:06.622679 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:06.623351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:06.627180 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:06.636543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8f21c06e-1531-4dff-9b78-0a004d58c69c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.189971 Oct 06 04:33:06.637127 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 72/145] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:06 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:06.761940 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:06.769930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4c67ff6a-a5a1-41ab-823d-3c37819d062e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.160933 Oct 06 04:33:06.770509 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 74/146] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:06 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:07.181970 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:07.183105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:07.192881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.193658 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.194360 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.195517 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.196351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.197147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.258371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:07.259746 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:07.267152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.267366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.267921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.268728 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.269290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.269954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.396010 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:07.408047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e759e297-1648-4dda-8ccd-a3c179041697 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.231079 Oct 06 04:33:07.408945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 73/147] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:07 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:07.443265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:07.452365 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:07.454138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:07.455279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e8e85827-0ae8-42ac-8d2e-b30184a4641c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.201396 Oct 06 04:33:07.455838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 75/148] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:07 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:07.540950 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:07.541430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:07.547432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.547911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.548339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.549029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.549472 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.549887 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.614783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:07.623298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b10e88fa-7366-44ad-93e0-bde8cccb086e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.086908 Oct 06 04:33:07.623877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 74/149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:07 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:07.662980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:07.663603 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:07.670402 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.670894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.671362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.672058 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.672511 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.672945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.794289 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:07.794905 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:07.800872 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.801353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.801780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.802471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:07.802914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:07.803355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:07.816517 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:07.825247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-651be4f7-04e2-4ac8-9479-c7758d1b269c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.166655 Oct 06 04:33:07.825840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 76/150] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:07 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:07.940006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:07.948480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-bbdcd8ad-0b50-4ff9-8f5f-3932eeee2edd tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.158696 Oct 06 04:33:07.949048 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 75/151] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:07 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:08.432569 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:08.433186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:08.438936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.439453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.439877 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.440730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.441337 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.441759 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.481929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:08.482721 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:08.490112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.490809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.491528 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.492405 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.493596 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.494363 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.605931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:08.613768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0d9cfed3-ad78-4d6a-9dbd-146a642b4fb0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.185596 Oct 06 04:33:08.614528 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 77/152] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:08 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:08.643078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:08.646510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:08.647209 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:08.652468 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:08.653854 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.653968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:08.654340 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.654853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.655055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3acb7581-545b-4575-b0ce-869a9930692c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.178020 Oct 06 04:33:08.655600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.656054 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.656524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.679125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 76/153] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:08 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:08.726140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:08.733929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-22752ab1-0e0a-4ad2-9d14-11ab08bf60a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.091430 Oct 06 04:33:08.738935 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 78/154] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:08 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:08.849272 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:08.850085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:08.859078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.859078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.859078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.859078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.859376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.859715 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.973172 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:08.973843 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:08.981232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.981949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.982570 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:08.983611 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:08.984239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:08.984668 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:09.009930 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:09.027107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ee1ed7fe-abe3-4313-aa80-5bc5527df693 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.181552 Oct 06 04:33:09.027700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 77/155] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:08 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:09.151309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:09.160341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f7cd5534-46ed-40be-96aa-6066988b3aa9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.191365 Oct 06 04:33:09.160925 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 79/156] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:08 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:09.638065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:09.638667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:09.641550 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:09.645562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:09.646041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:09.646470 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:09.647205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:09.647660 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:09.648070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:09.687016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:09.687627 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:09.694637 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:09.695156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:09.695588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:09.697322 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:09.698151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:09.699102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:09.826641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:09.832526 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:09.843308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-94cf7a15-8542-4822-85b3-ec8394ccf0e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.209725 Oct 06 04:33:09.844197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 78/157] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:09 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:09.849836 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:09.850723 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:09.857653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:09.858358 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:09.859001 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:09.860116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:09.860750 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:09.861491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:09.979908 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:09.981430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:09.990225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:09.992873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a3aa4d32-da1b-4bf8-b11d-94b26355eff3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.147087 Oct 06 04:33:09.993898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 79/158] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:09 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:09.996063 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:10.000153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-39fc4cf6-988f-438e-9aed-42fb0c4a7e26 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.316993 Oct 06 04:33:10.001404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 80/159] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:09 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:10.049744 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:10.050633 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:10.056798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:10.057582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:10.058174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:10.058876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:10.059358 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:10.059789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:10.184001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:10.184646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:10.190697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:10.191276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:10.191716 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:10.192420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:10.192867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:10.193290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:10.474240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:10.491654 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-504ebbfa-5f3b-4e87-ba1f-8760980e19ec tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.311697 Oct 06 04:33:10.496673 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 81/160] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:10 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:10.525801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:10.537332 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-47624df9-5557-4071-a50f-f0595e989132 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.491098 Oct 06 04:33:10.538672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 80/161] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:10 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:10.681098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-023a68d4-8f53-4e18-b45c-16da2e0eb28a req-4e32fd02-6110-445b-92b3-0f492aae46f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c46bbc-e699-4b17-99e5-d6a70df92e2c", "tag": "542157e8-aced-4f6a-815d-a118c4b3ca2c"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:10.691210 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-023a68d4-8f53-4e18-b45c-16da2e0eb28a req-4e32fd02-6110-445b-92b3-0f492aae46f1 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:10.692371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-023a68d4-8f53-4e18-b45c-16da2e0eb28a req-4e32fd02-6110-445b-92b3-0f492aae46f1 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:10.692942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-023a68d4-8f53-4e18-b45c-16da2e0eb28a req-4e32fd02-6110-445b-92b3-0f492aae46f1 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:10.707913 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-023a68d4-8f53-4e18-b45c-16da2e0eb28a req-4e32fd02-6110-445b-92b3-0f492aae46f1 service nova] Creating event network-changed:542157e8-aced-4f6a-815d-a118c4b3ca2c for instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c on hv-cinder-86022 Oct 06 04:33:10.721313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-023a68d4-8f53-4e18-b45c-16da2e0eb28a req-4e32fd02-6110-445b-92b3-0f492aae46f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044167 Oct 06 04:33:10.722677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 82/162] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:10.871733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:10.872422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:10.901606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:10.906378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:10.906829 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:10.907598 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:10.908053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:10.908666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.023496 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:11.025321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:11.033018 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.033514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.033945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.034644 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.035120 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.035556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.111288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:11.123658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0fb75808-c198-44ba-873e-8c6b29230f57 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.106969 Oct 06 04:33:11.125128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 83/163] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:11 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:11.129732 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:11.131106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:11.131863 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:11.138581 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.139113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.139693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.140489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.140988 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.141432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.146897 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f983dac0-06e2-4107-872a-08be23aad7d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.280592 Oct 06 04:33:11.147882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 81/164] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:10 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:11.159512 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-5040cbca-c1f7-4a28-9d09-45c92ad63fc4 req-793787bb-e584-4a21-9a56-5bc120306825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d111c647-dca9-45d6-96c6-13169658cac9", "tag": "b2a8d8d0-e0de-4959-a7d2-0d6f5be5fb38"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:11.165362 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5040cbca-c1f7-4a28-9d09-45c92ad63fc4 req-793787bb-e584-4a21-9a56-5bc120306825 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.165956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5040cbca-c1f7-4a28-9d09-45c92ad63fc4 req-793787bb-e584-4a21-9a56-5bc120306825 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.166387 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5040cbca-c1f7-4a28-9d09-45c92ad63fc4 req-793787bb-e584-4a21-9a56-5bc120306825 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.177713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-5040cbca-c1f7-4a28-9d09-45c92ad63fc4 req-793787bb-e584-4a21-9a56-5bc120306825 service nova] Creating event network-changed:b2a8d8d0-e0de-4959-a7d2-0d6f5be5fb38 for instance d111c647-dca9-45d6-96c6-13169658cac9 on hv-cinder-86022 Oct 06 04:33:11.182572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-5040cbca-c1f7-4a28-9d09-45c92ad63fc4 req-793787bb-e584-4a21-9a56-5bc120306825 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033181 Oct 06 04:33:11.183197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 82/165] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:11.317877 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:11.326065 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:11.327551 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:11.328672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ae317382-e428-4de4-973f-3a0ea6e1dd11 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.202314 Oct 06 04:33:11.329483 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 84/166] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:11 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:11.521154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:11.521852 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:11.528571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.529053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.529484 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.530170 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.530622 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.531078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.562135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:11.563325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:11.571836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.572466 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.573236 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.573951 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:11.574403 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:11.574826 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:11.713966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:11.722103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1ce4a2b4-eb89-4187-8bf8-b082a05881f6 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.164500 Oct 06 04:33:11.722223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:11.723088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 85/167] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:11 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:11.735214 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-631bbaf8-94c0-4a6f-87fd-5a8cc97861f4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.218153 Oct 06 04:33:11.736423 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 83/168] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:11 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:12.146605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:12.147163 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:12.153772 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.154263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.154706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.155434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.155893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.156316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.160379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:12.170948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:12.172609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:12.180107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.180811 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.181644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.182651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.183459 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.183918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.227739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:12.235384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bd63c7c5-13e3-4567-a667-a3ab0c4cdd61 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.090595 Oct 06 04:33:12.235384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 86/169] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:12 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:12.334754 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:12.342808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-61e2b52a-8e19-477f-93ad-2d1a20d44f73 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.175692 Oct 06 04:33:12.343410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 84/170] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:12 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:12.354824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:12.355448 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:12.361600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.362055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.362489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.363218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.363667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.364092 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.499275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:12.507430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:12.509601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:12.510906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e4b2a708-ee75-4b10-8880-d56c7a30f94e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.160779 Oct 06 04:33:12.511485 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 87/171] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:12 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:12.756189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:12.756861 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:12.761785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:12.762414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:12.763107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.763751 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.764185 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.765206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.765344 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.765945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.768153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.768637 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.769066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:12.770207 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:12.770626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:12.902222 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:12.910733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c18b3786-1527-47ff-81f1-c1731cd15c9f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.158241 Oct 06 04:33:12.923267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:12.923804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 85/172] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:12 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:12.929620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-15d5b84e-6618-47ca-beaf-139e800d9dc0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.168288 Oct 06 04:33:12.929620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 88/173] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:12 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:13.256522 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:13.257128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:13.264192 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.264677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.265112 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.265808 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.266267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.266689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.336065 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:13.345268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-07a2a6cb-e775-4255-8b88-9f1508413cfe tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.092507 Oct 06 04:33:13.345843 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 89/174] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:13 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:13.368244 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:13.368978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:13.374822 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.375338 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.375772 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.376464 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.376917 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.377336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.517404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:13.525666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4a4812e3-78c2-487b-8788-35c66e11fac3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.161550 Oct 06 04:33:13.526245 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 86/175] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:13 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:13.536886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:13.537725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:13.544194 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.544674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.545107 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.545790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.546239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.546655 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.687400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:13.695439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:13.697705 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:13.699003 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a359347a-c692-48a2-b43f-76f7dbb5f851 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.167138 Oct 06 04:33:13.699554 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 90/176] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:13 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:13.937403 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:13.938011 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:13.943973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.944450 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.945041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.946132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.946769 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.947178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.949161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:13.953226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:13.953836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:13.962281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.963379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.964042 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:13.965270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:13.966191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:13.966885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:14.120931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:14.128516 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-80586dd1-3ea7-43d3-a5b8-7d5d915e940d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.180356 Oct 06 04:33:14.129669 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 91/177] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:13 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:14.153089 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:14.160946 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5b115f7f-cbc5-4834-8e41-b21a811df56b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.227301 Oct 06 04:33:14.161525 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 87/178] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:13 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:14.368100 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:14.368809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:14.374595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:14.375251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:14.375685 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:14.376368 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:14.376813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:14.377229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:14.444182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:14.452098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-802af69d-12ea-4df8-b0db-80e0169255b6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.088051 Oct 06 04:33:14.452675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 92/179] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:14 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:14.549535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:14.550144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:14.557481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:14.557971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:14.558401 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:14.559124 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:14.559580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:14.560007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:14.700300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:14.708426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-297172d7-f60a-4808-9cb0-69d1ada976d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.162678 Oct 06 04:33:14.708998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 88/180] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:14 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:14.726710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:14.727931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:14.733706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:14.734189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:14.734690 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:14.735352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:14.735807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:14.736238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:14.868701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:14.876877 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:14.878306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:14.879460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8e42dcd8-7084-405b-9196-8146e2741359 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.159168 Oct 06 04:33:14.880017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 93/181] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:14 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:15.151976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:15.152607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:15.158478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.159166 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.159800 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.160534 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.161144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.161568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.186413 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:15.187227 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:15.194112 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.194753 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.195313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.196184 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.196777 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.197317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.306200 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:15.316361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fefc7e9c-14d0-4004-81c3-093ebbf738ae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.168651 Oct 06 04:33:15.316939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 89/182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:15 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:15.363081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:15.375918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-afebf223-44ff-4b49-8529-a0a873beddce tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.193854 Oct 06 04:33:15.376812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 94/183] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:15 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:15.474965 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:15.475585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:15.482584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.483329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.483754 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.484447 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.484893 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.485305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.583699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:15.593849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-723f10ae-1240-4857-90e8-b838f68e35f3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.122545 Oct 06 04:33:15.601123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 90/184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:15 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:15.731507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:15.732118 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:15.737975 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.738450 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.738879 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.739590 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.740037 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.740454 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.873123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:15.880804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d444fa65-9fb4-472e-89a6-229650d71ba1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.153135 Oct 06 04:33:15.881361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 95/185] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:15 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:15.904899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:15.905501 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:15.911443 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.911926 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.912354 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:15.913042 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:15.913496 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:15.913914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:16.099899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:16.109029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:16.111548 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:16.113632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f4d49c14-1eed-4154-8d05-2cd3c27828da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.211798 Oct 06 04:33:16.128404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 91/186] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:15 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:16.339931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:16.340553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:16.347146 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:16.347980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:16.348574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:16.349287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:16.349747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:16.350169 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:16.400569 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:16.401311 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:16.407892 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:16.408390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:16.408845 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:16.420036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:16.420516 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:16.420953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:16.516689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:16.528646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-72587bbd-70c7-47ed-a5a1-67bfb0b8781a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.192420 Oct 06 04:33:16.529384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 96/187] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:16 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:16.618084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:16.618690 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:16.624864 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:16.632090 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:16.637195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fa84baf6-4695-40ca-84c7-e9c95666d0cf tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.241496 Oct 06 04:33:16.638380 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 92/188] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:16 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:16.639333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:16.639963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:16.640878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:16.641508 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:16.642208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:16.731332 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:16.744366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5012ee97-26e2-466e-865d-1b284abf54a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.129823 Oct 06 04:33:16.745682 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 97/189] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:16 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:16.903667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:16.904266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:16.910659 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:16.911174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:16.911804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:16.912502 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:16.912951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:16.913362 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.068801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:17.076825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-979e8ea9-ca7a-4a0b-a811-aaa98107937d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.176978 Oct 06 04:33:17.077558 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 93/190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:16 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:17.141491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:17.142126 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:17.147979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:17.148463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:17.149475 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.150165 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:17.150626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:17.151075 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.300372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:17.308845 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:17.310271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:17.311387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-538185cb-bb9e-4a23-8fa7-a37844ab475e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.173739 Oct 06 04:33:17.312249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 98/191] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:17 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:17.553510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:17.554155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:17.560550 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:17.561064 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:17.561772 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.562495 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:17.563343 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:17.563931 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.663020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:17.663727 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:17.673472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:17.674070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:17.674553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.675359 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:17.675949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:17.676380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.828701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:17.839366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c8d683e7-b175-432f-8f18-9f6e56750737 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.290029 Oct 06 04:33:17.851674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:17.853110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 94/192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:17 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:17.858763 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-367000c3-80a2-46ba-932a-bb472123f29b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.198428 Oct 06 04:33:17.859282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 99/193] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:17 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:17.865481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:17.866446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:17.874674 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:17.875447 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:17.876156 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.877025 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:17.877583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:17.878099 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:17.956196 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:17.964594 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fd9bc8c2-ed10-4597-b99a-2a0b3902795e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1307 microversion: 2.1 time: 0.110166 Oct 06 04:33:17.965381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 95/194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:17 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:18.112441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:18.113058 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:18.119821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.120307 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.120734 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:18.121439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.122066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.122487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:18.207182 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-0a9201bf-7863-40c5-877a-688837266cb6 req-3d2258d7-7143-4ca4-bad2-63c545cfd74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f70ee71-4e29-4e3b-8073-d006f525c847", "name": "network-vif-plugged", "status": "completed", "tag": "82231974-6803-4127-b9f5-c7ea01ea019f"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:18.217926 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0a9201bf-7863-40c5-877a-688837266cb6 req-3d2258d7-7143-4ca4-bad2-63c545cfd74f service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.218412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0a9201bf-7863-40c5-877a-688837266cb6 req-3d2258d7-7143-4ca4-bad2-63c545cfd74f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.218836 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0a9201bf-7863-40c5-877a-688837266cb6 req-3d2258d7-7143-4ca4-bad2-63c545cfd74f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:18.222869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:18.231702 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-0a9201bf-7863-40c5-877a-688837266cb6 req-3d2258d7-7143-4ca4-bad2-63c545cfd74f service nova] Creating event network-vif-plugged:82231974-6803-4127-b9f5-c7ea01ea019f for instance 4f70ee71-4e29-4e3b-8073-d006f525c847 on hv-cinder-86022 Oct 06 04:33:18.237372 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-0a9201bf-7863-40c5-877a-688837266cb6 req-3d2258d7-7143-4ca4-bad2-63c545cfd74f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112430 Oct 06 04:33:18.237963 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 96/195] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:33:18.287551 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:18.297432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-887fc018-e1d8-461e-a956-8ec18c2aabf1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.189809 Oct 06 04:33:18.298010 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 100/196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:18 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:18.338873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:18.339597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:18.345684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.346330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.352524 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:18.353508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.354054 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.354486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:18.625666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:18.634935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:18.636540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:18.637913 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e8eee2e2-f9f6-488a-a843-f693145db7cc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.304634 Oct 06 04:33:18.639198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 97/197] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:18 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:18.865368 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:18.866451 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:18.873754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.874244 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.875030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:18.875876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.876324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.876882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:18.883779 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:18.884944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:18.907376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.907886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.917116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:18.920349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:18.922609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:18.923799 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:19.095453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:19.105282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ac939894-f58d-482d-a885-36855bed2209 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.243309 Oct 06 04:33:19.106335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 101/198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:18 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:19.123172 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:19.123776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:19.131804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:19.132285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:19.132878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:19.134005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:19.134605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:19.134768 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:19.135362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:19.155015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ca52c882-2297-4b2e-b979-f3999e23cd88 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.274822 Oct 06 04:33:19.156056 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 98/199] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:18 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:19.293951 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:19.297379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:19.302452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2845f7de-f6bd-462b-a05c-921c4102f4da tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1375 microversion: 2.1 time: 0.194892 Oct 06 04:33:19.303038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 102/200] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:19 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:19.327173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:19.328119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:19.334562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:19.335178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:19.335741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:19.336626 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:19.337457 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:19.338051 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:19.487680 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:19.495571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-723a8949-f582-491a-8ac5-077e7a980f57 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.173575 Oct 06 04:33:19.496122 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 99/201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:19 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:19.666418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:19.666985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:19.672834 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:19.673316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:19.673747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:19.674441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:19.674894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:19.675345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:19.810586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:19.818726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:19.820204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:19.821803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-09c3f887-61de-4921-9c13-e3893a4df281 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.160029 Oct 06 04:33:19.822351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 103/202] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:19 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:20.128556 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:20.129144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:20.135576 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.136052 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.136479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.137154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.137603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.138015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.178337 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:20.178939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:20.185364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.185850 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.186290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.186993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.187446 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.187873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.269501 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:20.277337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0f67f8c9-e20c-42bd-a6bc-6f935a5c2f85 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.152579 Oct 06 04:33:20.277916 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 100/203] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:20 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:20.316472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:20.325480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5626df84-f76c-416a-b5b4-67a1cd3a9615 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.150930 Oct 06 04:33:20.325639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:20.326238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 104/204] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:20 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:20.326377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:20.332353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.332835 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.333262 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.333957 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.334434 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.334858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.462460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:20.470073 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-83a8d804-d96a-4000-a9cc-c20b52d4c432 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1375 microversion: 2.1 time: 0.148277 Oct 06 04:33:20.470636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 101/205] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:20 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1375 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:20.517363 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:20.517963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:20.523826 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.524260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.524688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.525366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.525812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.526232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.649406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:20.656853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f5b7a0cf-fda3-4349-b715-0e7a77f9a9a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.143210 Oct 06 04:33:20.657428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 105/206] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:20 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:20.846545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:20.847173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:20.853701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.854179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.854608 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:20.855316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:20.855764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:20.856211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.165746 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:21.173584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:21.175028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:21.176121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-26cb1aba-f395-494c-a4e0-6d0e6b70d0e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.333415 Oct 06 04:33:21.176687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 102/207] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:20 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:21.300317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:21.300957 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:21.307472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:21.307954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:21.308386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.309071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:21.309525 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:21.309956 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.348055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:21.348783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:21.356006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:21.356500 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:21.356940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.357644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:21.358101 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:21.358529 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.438828 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:21.446643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8ceacae8-be61-4d02-a1dd-1048f7959a16 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.150099 Oct 06 04:33:21.447240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 106/208] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:21 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:21.494456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:21.494981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:21.495601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:21.501590 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:21.502080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:21.502511 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.502833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ee7a6344-d441-4dd2-b1b1-e4d518d5e8a8 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.158543 Oct 06 04:33:21.503401 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:21.503524 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 103/209] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:21 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:21.504138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:21.504720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.636330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:21.646098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cc329543-661c-4b00-8f2c-36b5cd5390f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1375 microversion: 2.1 time: 0.157145 Oct 06 04:33:21.646600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 107/210] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:21 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:21.681020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:21.681635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:21.687526 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:21.688011 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:21.688450 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.689142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:21.689595 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:21.690021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:21.829887 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:21.837734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-258b57c8-662a-4cf0-b62c-56f0fc1bba88 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.161371 Oct 06 04:33:21.838301 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 104/211] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:21 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:22.200951 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:22.201588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:22.207720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.208207 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.208648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.209351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.209801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.210301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.421462 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:22.434898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:22.436512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:22.438031 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-96b1e3c7-ba9d-4b8a-9898-263eaa4ac4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.240960 Oct 06 04:33:22.439127 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 108/212] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:22 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:22.471978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:22.473260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:22.485506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.497404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.498011 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.498793 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.500427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.500858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.526993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:22.531898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:22.540397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.541505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.542163 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.543292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.544469 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.545167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.730684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:22.738434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1d589f6e-26b9-4dd1-9561-6ca6dd59b938 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.215534 Oct 06 04:33:22.739177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 109/213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:22 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:22.747785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:22.748463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:22.754317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.754793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.755246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.755960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.756411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.756834 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.819768 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:22.827812 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-85eb89a6-e229-4208-9f69-b60240b64283 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.361674 Oct 06 04:33:22.828386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 105/214] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:22 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:22.859695 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:22.860305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:22.866301 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.867018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.868871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.869605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:22.870718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:22.871201 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:22.892444 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:22.901595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f9a00020-8323-4c9f-b7b1-aad20b0bfba9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.157415 Oct 06 04:33:22.902456 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 110/215] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:22 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:23.240375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:23.250615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fa82d65a-6f4e-4d8c-90ad-25a5b0b446f2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.394665 Oct 06 04:33:23.251376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 106/216] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:22 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:23.464373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:23.465116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:23.474773 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:23.475311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:23.475801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:23.476513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:23.477566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:23.477995 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:23.763321 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:23.763907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:23.770949 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:23.771406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:23.772035 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:23.772733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:23.773179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:23.774820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:23.882255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:23.892353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:23.894129 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:23.895684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bc8db418-ea2a-4a43-8d69-bed7a4ad65e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.437118 Oct 06 04:33:23.896683 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 111/217] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:23 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:23.902341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:23.903191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:23.909526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:23.910216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:23.910654 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:23.911380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:23.911984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:23.912566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:24.084564 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:24.092714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4542789d-fb06-486c-86c5-bcd38c155173 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.194765 Oct 06 04:33:24.093307 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 112/218] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:23 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:24.098093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:24.098931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:24.105531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:24.106383 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:24.107079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:24.108009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:24.108691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:24.109196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:24.337947 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:24.346501 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-83d70fd7-73a3-4135-b1e0-32e50df2a836 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.251987 Oct 06 04:33:24.347684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 113/219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:24 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:24.355695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:24.356605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:24.363626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:24.364410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:24.365076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:24.366024 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:24.366706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:24.368270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:24.554002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:24.564933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ed0bd95d-1a55-4f30-8538-c12fd4e616dc tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.807849 Oct 06 04:33:24.567235 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 107/220] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:23 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:24.584630 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-570c87a5-6e3c-4fbf-a0c2-c7f8bd5df52d req-e529402a-bc62-49e5-83f6-028be54fd28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc52256a-9199-4650-94d2-898dc19ce71d", "tag": "09cdf9f1-3de3-4c28-bc6f-d5c72cb9470e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:24.598088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-570c87a5-6e3c-4fbf-a0c2-c7f8bd5df52d req-e529402a-bc62-49e5-83f6-028be54fd28c service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:24.598825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-570c87a5-6e3c-4fbf-a0c2-c7f8bd5df52d req-e529402a-bc62-49e5-83f6-028be54fd28c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:24.600413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-570c87a5-6e3c-4fbf-a0c2-c7f8bd5df52d req-e529402a-bc62-49e5-83f6-028be54fd28c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:24.616764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-570c87a5-6e3c-4fbf-a0c2-c7f8bd5df52d req-e529402a-bc62-49e5-83f6-028be54fd28c service nova] Creating event network-changed:09cdf9f1-3de3-4c28-bc6f-d5c72cb9470e for instance dc52256a-9199-4650-94d2-898dc19ce71d on hv-cinder-86022 Oct 06 04:33:24.624856 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-570c87a5-6e3c-4fbf-a0c2-c7f8bd5df52d req-e529402a-bc62-49e5-83f6-028be54fd28c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056221 Oct 06 04:33:24.626030 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 108/221] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:24.693675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:24.701277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-004ed3f8-c04b-4f17-b303-034e63a79da5 req-beb1b6bf-2c62-4bd4-a14d-e09ed7b8fd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1de82b-ccd4-4783-8f2b-8db183ab18ae", "name": "network-vif-plugged", "status": "completed", "tag": "32169a85-ede4-4200-8d87-9cc5853244e1"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:24.704008 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-99b55722-56be-479b-a17f-fd2853ef7831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.354886 Oct 06 04:33:24.704616 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 114/222] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:24 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:24.757720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-004ed3f8-c04b-4f17-b303-034e63a79da5 req-beb1b6bf-2c62-4bd4-a14d-e09ed7b8fd72 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:24.758783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-004ed3f8-c04b-4f17-b303-034e63a79da5 req-beb1b6bf-2c62-4bd4-a14d-e09ed7b8fd72 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:24.759312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-004ed3f8-c04b-4f17-b303-034e63a79da5 req-beb1b6bf-2c62-4bd4-a14d-e09ed7b8fd72 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:24.771415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-004ed3f8-c04b-4f17-b303-034e63a79da5 req-beb1b6bf-2c62-4bd4-a14d-e09ed7b8fd72 service nova] Creating event network-vif-plugged:32169a85-ede4-4200-8d87-9cc5853244e1 for instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae on hv-cinder-86022 Oct 06 04:33:24.777768 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-004ed3f8-c04b-4f17-b303-034e63a79da5 req-beb1b6bf-2c62-4bd4-a14d-e09ed7b8fd72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084479 Oct 06 04:33:24.778438 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 109/223] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:33:24.922806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:24.923438 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:24.929606 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:24.930215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:24.930687 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:24.931421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:24.931870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:24.932312 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:25.072689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:25.080833 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:25.082280 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:25.083412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-62de9394-e128-4c8a-9c7f-d94c28fef9a2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.164555 Oct 06 04:33:25.083971 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 115/224] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:24 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:25.116002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:25.116939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:25.124518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:25.125091 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:25.125692 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:25.126460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:25.126985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:25.127414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:25.422420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:25.428546 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:25.436624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:25.437182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:25.437899 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:25.439333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:25.439798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:25.440216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:25.462311 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:25.471347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4e03ef8e-7c96-4201-a1e3-d1328931ad0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.359595 Oct 06 04:33:25.472008 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 110/225] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:25 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:25.577001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:25.584973 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7a14047f-5f67-4dd7-851a-1406f9f2e51a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.219121 Oct 06 04:33:25.597914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 116/226] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:25 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:25.598282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:25.598282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:25.598282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:25.598282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:25.598614 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:25.598614 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:25.598984 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:25.599462 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:25.727644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:25.730713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:25.731343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:25.735452 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-023a3be5-28c4-40bd-9a67-56409d637329 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.149535 Oct 06 04:33:25.736168 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 111/227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:25 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:25.737719 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:25.738198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:25.738626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:25.739578 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:25.740179 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:25.740757 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.108939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:26.110102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:26.115876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:26.116363 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:26.116790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.117998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:26.118624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:26.119134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.213623 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:26.261290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-09afcf61-42ba-451e-9470-fa336037e3e1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.534377 Oct 06 04:33:26.261425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:26.261882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 117/228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:25 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:26.272348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:26.274091 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:26.275329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9e19b558-6e40-4217-87e5-bade5dff031a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.170195 Oct 06 04:33:26.276338 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 112/229] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:26 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:26.495410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:26.496075 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:26.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:26.502448 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:26.502885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.503605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:26.504090 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:26.504521 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.608422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:26.609129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:26.615154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:26.615625 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:26.616062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.616756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:26.617966 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:26.618393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.630819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:26.639203 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4584a127-e1e0-46e7-bdc0-445c01a30bae tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.148037 Oct 06 04:33:26.639776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 118/230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:26 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:26.748409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:26.759091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:26.760333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:26.761725 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c310d875-6628-416c-9de0-622d25174776 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.156950 Oct 06 04:33:26.762433 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 113/231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:26 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:26.767949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:26.768534 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:26.768966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.769861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:26.770316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:26.770743 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:26.790012 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:26.908995 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:26.916733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-87ed82db-644e-4a22-8794-4431f89a8032 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.161733 Oct 06 04:33:26.917298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 119/232] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:26 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:27.285803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:27.286431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:27.292783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.293269 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.293706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.294398 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.294866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.295310 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.301410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:27.302026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:27.308821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.309312 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.309744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.310854 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.310854 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.311349 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.439326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:27.443357 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:27.456141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:27.456944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-78cab42d-d872-4db7-b231-21bdff1911da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.174884 Oct 06 04:33:27.457533 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 114/233] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:27 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:27.465385 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:27.467051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:27.468096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f0dc5093-8a2e-4b3d-855d-5ff637e4a17c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.170581 Oct 06 04:33:27.475014 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 120/234] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:27 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:27.663353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:27.664283 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:27.672037 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.672739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.673414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.674934 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.675952 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.675952 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.785624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:27.786344 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:27.792317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.792875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.793377 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.794133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.794653 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.795197 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.815743 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:27.825908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fa396e84-0a50-4819-8c57-f784094da6a5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.167592 Oct 06 04:33:27.826497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 115/235] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:27 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:27.945002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:27.946774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:27.952384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.953239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.953373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.953982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:27.954439 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:27.954862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:27.984827 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:27.993210 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7267284a-17a0-44c7-8650-63b165d45985 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.211249 Oct 06 04:33:27.993793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 121/236] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:27 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:28.102573 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:28.110198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c4daf1b3-e24f-4ca2-aa8f-e905ba80ab2a tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1314 microversion: 2.1 time: 0.170101 Oct 06 04:33:28.111062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 116/237] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:27 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:28.479919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:28.480526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:28.500415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:28.501714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:28.502271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:28.502423 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:28.502641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:28.503400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:28.503850 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:28.504272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:28.515871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:28.518450 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:28.518916 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:28.524230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:28.524914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:28.525347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:28.844522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:28.857914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:28.860928 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:28.865263 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4c9c056d-4e26-41f4-924f-3105dea4362e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.373037 Oct 06 04:33:28.866624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 117/238] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:28 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:28.884428 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:28.885171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:28.900123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:28.904343 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:28.908541 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:28.909711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5d511544-d0c8-4092-a599-0f17e436949d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.434182 Oct 06 04:33:28.910125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:28.912082 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 122/239] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:28 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:28.912755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:28.913425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:28.914136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:29.019176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:29.019176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:29.020571 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:29.028408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:29.029496 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:29.030062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:29.030626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:29.031322 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:29.031752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:29.140649 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:29.149080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-51882172-f2bf-4d35-b672-9149e2ebdd6c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.281223 Oct 06 04:33:29.151221 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 118/240] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:28 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:29.169391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:29.171308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:29.185890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:29.186497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:29.187072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:29.187980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:29.188540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:29.189077 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:29.298692 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:29.312026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f5605cf5-a003-42dc-abb6-5113eaafde5a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.299130 Oct 06 04:33:29.312650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 123/241] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:29 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:29.515707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:29.523425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8bc46fda-5dd6-451f-b1e0-abe619ad074f tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1502 microversion: 2.1 time: 0.370731 Oct 06 04:33:29.524002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 119/242] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:29 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:29.893107 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:29.893956 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:29.901509 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:29.902609 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:29.903101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:29.903953 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:29.904406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:29.904836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:29.935890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:29.936841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:29.943186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:29.943668 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:29.944403 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:29.945381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:29.945836 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:29.946275 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:30.059776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:30.070696 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:30.072335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:30.074221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-41871f6d-418e-4309-866c-28b88479aa6a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.184603 Oct 06 04:33:30.075344 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 124/243] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:29 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:30.107583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:30.114880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0591e2ff-1e12-4d0f-ba6a-5d31ea30c5ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.182794 Oct 06 04:33:30.115646 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 120/244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:29 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:30.175929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:30.176564 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:30.183169 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:30.183658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:30.184108 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:30.184800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:30.185256 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:30.185681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:30.337412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:30.339603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:30.340437 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:30.346728 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d1d711e3-bc1c-4b75-ba4a-ace138bbd161 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.174365 Oct 06 04:33:30.347375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:30.348051 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:30.348654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:30.349635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:30.350268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:30.350868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:30.360038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 125/245] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:30 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:30.510480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:30.520361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-eb3d6398-ff0f-49a3-9268-8fef2e6ca6d0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.185186 Oct 06 04:33:30.521065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 121/246] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:30 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:30.705639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-802db2f7-ee63-4f85-b897-34f28ea2726d req-bb8f53f5-a8c5-4a75-b97a-93b3be76b14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba369ba5-73dc-42d2-a375-b15b0e42188c", "name": "network-vif-plugged", "status": "completed", "tag": "6388b760-70f1-47b6-a577-dd35569e080b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:30.716804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-802db2f7-ee63-4f85-b897-34f28ea2726d req-bb8f53f5-a8c5-4a75-b97a-93b3be76b14c service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:30.717303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-802db2f7-ee63-4f85-b897-34f28ea2726d req-bb8f53f5-a8c5-4a75-b97a-93b3be76b14c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:30.717900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-802db2f7-ee63-4f85-b897-34f28ea2726d req-bb8f53f5-a8c5-4a75-b97a-93b3be76b14c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:30.732340 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-802db2f7-ee63-4f85-b897-34f28ea2726d req-bb8f53f5-a8c5-4a75-b97a-93b3be76b14c service nova] Creating event network-vif-plugged:6388b760-70f1-47b6-a577-dd35569e080b for instance ba369ba5-73dc-42d2-a375-b15b0e42188c on hv-cinder-86022 Oct 06 04:33:30.737963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-802db2f7-ee63-4f85-b897-34f28ea2726d req-bb8f53f5-a8c5-4a75-b97a-93b3be76b14c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036173 Oct 06 04:33:30.738819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 126/247] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:30.953364 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aac823a-0adf-4809-b35f-b0fd8c526631"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:30.955776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:30.961981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:30.962852 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:30.963532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:30.964290 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:30.964781 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:30.965362 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.103908 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:31.104597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:31.111824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:31.112313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:31.112747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.113445 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:31.113913 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:31.115488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.271573 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:31.280867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:31.282713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:31.284196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b89e985b-a68e-4592-a621-31ba20554f2f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.185148 Oct 06 04:33:31.285092 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 127/248] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:31 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:31.290360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:31.290984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:31.296696 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:31.297173 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:31.297830 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.298537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:31.298986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:31.299585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.442371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:31.453309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f8c02446-1938-4901-8e11-b82ec600b15a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.166903 Oct 06 04:33:31.453894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 128/249] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:31 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:31.458331 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:31.458933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:31.465938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:31.466418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:31.466842 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.467602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:31.468217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:31.468798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.615919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:31.626156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-186804b7-840d-48d3-9570-9bfc9469b6e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.171377 Oct 06 04:33:31.627059 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 129/250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:31 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:31.633231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:31.634778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:31.640723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:31.641466 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:31.642127 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.643055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:31.643714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:31.644218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:31.800255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:31.809658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-edd38c3a-349c-4dbd-8c61-78f88b48a3bd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.180857 Oct 06 04:33:31.810234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 130/251] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:31 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:32.312330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:32.312956 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:32.318837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:32.319360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:32.319798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:32.320525 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:32.321123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:32.321901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:32.509633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:32.518017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:32.519717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:32.520824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a8371d3a-213b-4b1b-b791-0c6bc3188ff8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.212431 Oct 06 04:33:32.521380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 131/252] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:32 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:32.532465 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:32.532718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:32.539432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:32.539910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:32.540348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:32.541052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:32.541504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:32.542189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:32.689005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:32.701861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e0479499-fbfd-4a97-82c6-64e6d15d9bb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.177672 Oct 06 04:33:32.703800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 132/253] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:32 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:32.710469 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:32.712511 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:32.721567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:32.723607 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:32.724351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:32.725709 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:32.725709 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:32.726075 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:32.870523 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:32.878674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7999e50f-10a9-42ec-8286-faf417f5a469 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.173747 Oct 06 04:33:32.879274 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 133/254] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:32 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:32.884283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:32.884883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:32.890434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:32.890919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:32.891390 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:32.892274 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:32.892718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:32.893145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:33.064837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:33.074103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5fa63a70-ae09-4ead-932f-a542a31d273e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.193821 Oct 06 04:33:33.074705 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 134/255] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:32 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:33.548240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:33.549124 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:33.558360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:33.559101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:33.559769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:33.560666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:33.561301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:33.561855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:33.706118 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:33.716637 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:33.718742 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:33.719885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7499084d-7a2c-47c1-bcce-63d36b6bafb9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.177252 Oct 06 04:33:33.720908 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 135/256] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:33 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:33.728443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:33.729237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:33.735206 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:33.735693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:33.736127 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:33.736815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:33.737266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:33.737687 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:33.880131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:33.884314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:33.889870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cd89ccae-a892-4db4-98e7-c33f6acfbd64 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.165863 Oct 06 04:33:33.890704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 136/257] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:33 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:33.903447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:33.904802 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:33.911842 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:33.912325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:33.912861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:33.913750 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:33.914530 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:33.914975 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:34.045878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:34.053446 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f6d060ef-06a3-4a53-8f89-745c24217943 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.155222 Oct 06 04:33:34.058769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 137/258] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:33 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:34.100967 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:34.103191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:34.113834 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:34.114629 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:34.115170 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:34.116341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:34.117604 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:34.118599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:34.256412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:34.265115 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-92d14575-b488-406c-817a-a56bccaa6b13 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.170762 Oct 06 04:33:34.265727 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 138/259] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:34 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:34.746660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:34.747231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:34.752942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:34.753432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:34.753867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:34.754646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:34.755079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:34.755602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:34.900432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:34.909299 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:34.910913 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:34.912075 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-487c90b8-29f7-4c8b-a880-9b2f5369a6bc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.170630 Oct 06 04:33:34.912640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 139/260] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:34 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:34.920488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:34.921423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:34.928925 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:34.930409 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:34.931229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:34.932029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:34.932555 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:34.933080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:35.087295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:35.097825 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5a2180dc-5ddf-4d40-8e6c-86db7b4bc1a1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.183425 Oct 06 04:33:35.100824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 140/261] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:34 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:35.106182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-3f6ac4df-aada-451a-a3d7-be68bf488349 req-fa0d9655-7241-4579-b2bd-10fb96e4a705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d111c647-dca9-45d6-96c6-13169658cac9", "name": "network-vif-plugged", "status": "completed", "tag": "b2a8d8d0-e0de-4959-a7d2-0d6f5be5fb38"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:35.115709 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-3f6ac4df-aada-451a-a3d7-be68bf488349 req-fa0d9655-7241-4579-b2bd-10fb96e4a705 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:35.116183 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-3f6ac4df-aada-451a-a3d7-be68bf488349 req-fa0d9655-7241-4579-b2bd-10fb96e4a705 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:35.118150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-3f6ac4df-aada-451a-a3d7-be68bf488349 req-fa0d9655-7241-4579-b2bd-10fb96e4a705 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:35.129380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-3f6ac4df-aada-451a-a3d7-be68bf488349 req-fa0d9655-7241-4579-b2bd-10fb96e4a705 service nova] Creating event network-vif-plugged:b2a8d8d0-e0de-4959-a7d2-0d6f5be5fb38 for instance d111c647-dca9-45d6-96c6-13169658cac9 on hv-cinder-86022 Oct 06 04:33:35.135292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-3f6ac4df-aada-451a-a3d7-be68bf488349 req-fa0d9655-7241-4579-b2bd-10fb96e4a705 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032554 Oct 06 04:33:35.136561 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 141/262] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:35.147532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:35.147532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:35.150693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:35.151219 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:35.151652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:35.152375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:35.152814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:35.153337 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:35.293654 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:35.301325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fcd2d149-3232-4cc5-b556-2a63dff90de0 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.163277 Oct 06 04:33:35.301890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 142/263] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:35 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:35.306691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:35.307336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:35.312985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:35.313464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:35.313892 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:35.314582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:35.315059 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:35.315484 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:35.496364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:35.504052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-db7fb18e-a250-4387-aa3e-00f0d31e4215 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.200966 Oct 06 04:33:35.504684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 143/264] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:35 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:35.936674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:35.937934 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:35.944066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:35.944557 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:35.945064 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:35.945859 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:35.946314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:35.947116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:36.099342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:36.110151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:36.111808 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:36.113670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fe915772-746c-4cca-a972-a1af29a6ded2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.180516 Oct 06 04:33:36.116677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 144/265] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:35 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:33:36.123930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:36.124545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:36.133051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:36.133776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:36.134176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:36.134885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:36.135498 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:36.136098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:36.277284 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:36.285809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f3ec01f0-a383-4040-a1c3-48b3efad70a3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.165433 Oct 06 04:33:36.286460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 145/266] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:36 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:36.326872 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:36.327681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:36.334458 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:36.334949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:36.335421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:36.337109 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:36.337592 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:36.338016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:36.514159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:36.522663 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d93ce0cb-b710-45d2-a53d-1fdfa7eb504a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.199467 Oct 06 04:33:36.535074 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 146/267] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:36 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:36.539745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:36.540385 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:36.546746 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:36.547336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:36.547784 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:36.548542 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:36.549002 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:36.549475 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:36.692189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:36.701081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1da4a6c4-9a0c-4d7c-8e6a-f80df5b7106f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.175512 Oct 06 04:33:36.701586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 147/268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:36 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:37.138944 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:37.140583 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:37.152342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:37.153076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:37.153714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:37.154566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:37.155189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:37.155821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:37.295076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:37.303221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:37.305343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:37.306741 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b19ba6a5-826a-4373-a4f9-bf60e5a49182 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.172868 Oct 06 04:33:37.307329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 148/269] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:37 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:37.311676 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:37.312272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:37.318493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:37.319090 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:37.319587 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:37.320992 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:37.321534 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:37.322029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:37.493276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:37.510924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b83f0b3e-0465-4614-9528-2159e655b813 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.201988 Oct 06 04:33:37.511907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 149/270] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:37 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:37.548145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:37.548760 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:37.566310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:37.566811 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:37.567283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:37.567995 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:37.568470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:37.568897 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:37.801320 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:37.811345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-eb60689b-f96d-45de-a60f-6dbd62337953 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.266403 Oct 06 04:33:37.812139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 150/271] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:37 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:37.859698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:37.862969 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:37.871214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:37.871979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:37.872565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:37.873675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:37.874644 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:37.875532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:37.876898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-75d10268-ad4e-44f7-a735-29731e09e2a1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "POST /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.926580 Oct 06 04:33:37.877705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 122/272] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:33:30 2022] POST /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847/os-volume_attachments => generated 194 bytes in 6929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:38.160510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:38.175402 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-634286c5-f14a-45ab-aa08-248acc7e9029 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.329054 Oct 06 04:33:38.176275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 151/273] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:37 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:38.333333 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:38.334128 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:38.340494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:38.341057 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:38.341491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:38.342228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:38.342686 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:38.344700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:38.534373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:38.535213 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:38.542449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:38.542934 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:38.543501 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:38.544205 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:38.544656 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:38.548664 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:38.728102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:38.743443 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:38.745213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:38.746518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-01bde013-66a8-4e6f-8fcd-88176824d53a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.418056 Oct 06 04:33:38.747614 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 123/274] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:38 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:38.789630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:38.803783 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ff013d4e-0a0e-49e9-9bf5-bad2a0250392 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.271413 Oct 06 04:33:38.805471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 152/275] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:38 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:38.837079 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:38.837692 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:38.844666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:38.845544 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:38.845977 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:38.846739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:38.847217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:38.847638 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:38.984375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:38.993623 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-904dea19-0095-402d-9b2e-9f228a6de674 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.161161 Oct 06 04:33:39.012402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 124/276] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:38 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:39.204179 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:39.205337 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:39.233701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:39.234490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:39.234930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:39.236230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:39.238581 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:39.239040 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:39.522277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:39.542208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4a308d48-0338-49e6-b19c-93fbf93212e3 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.346527 Oct 06 04:33:39.555793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 153/277] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:39 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:39.777959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:39.777959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:39.779556 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=93 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:39.785178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:39.785670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:39.786112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:39.786815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:39.787408 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:39.787845 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:39.828102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:39.828652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:39.835625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:39.836942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:39.837384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:39.838096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:39.838758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:39.839579 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:39.844912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:39.966390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:39.980589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:39.982057 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:39.983198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-cf166ac8-4bc9-459f-9969-1d5b67dd2311 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.213322 Oct 06 04:33:39.983924 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 125/278] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:39 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:40.001935 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:40.010401 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e61e1789-9277-4037-8809-c29eeaf8394c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.186296 Oct 06 04:33:40.012488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 154/279] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:39 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:40.022386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:40.023840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:40.029693 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:40.030180 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:40.030613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:40.031357 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:40.031806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:40.032225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:40.188492 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:40.196482 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6bf1cbcd-29c4-4006-aa6d-9e0bd45132e2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.179251 Oct 06 04:33:40.197054 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 126/280] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:40 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:40.574263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:40.576276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:40.588826 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:40.591598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:40.592884 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:40.596127 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:40.598764 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:40.599596 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:40.770713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-9bc54a5c-492d-4721-89df-f5e8e3da0bfa req-f8f4e275-16a3-4984-938d-e83442772e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc52256a-9199-4650-94d2-898dc19ce71d", "name": "network-vif-plugged", "status": "completed", "tag": "09cdf9f1-3de3-4c28-bc6f-d5c72cb9470e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:40.786659 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-9bc54a5c-492d-4721-89df-f5e8e3da0bfa req-f8f4e275-16a3-4984-938d-e83442772e38 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:40.787159 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-9bc54a5c-492d-4721-89df-f5e8e3da0bfa req-f8f4e275-16a3-4984-938d-e83442772e38 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:40.787587 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-9bc54a5c-492d-4721-89df-f5e8e3da0bfa req-f8f4e275-16a3-4984-938d-e83442772e38 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:40.815250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:40.816698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-9bc54a5c-492d-4721-89df-f5e8e3da0bfa req-f8f4e275-16a3-4984-938d-e83442772e38 service nova] Creating event network-vif-plugged:09cdf9f1-3de3-4c28-bc6f-d5c72cb9470e for instance dc52256a-9199-4650-94d2-898dc19ce71d on hv-cinder-86022 Oct 06 04:33:40.825309 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-9bc54a5c-492d-4721-89df-f5e8e3da0bfa req-f8f4e275-16a3-4984-938d-e83442772e38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058271 Oct 06 04:33:40.826247 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 127/281] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:33:40.827806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ae7b8a48-d0b5-4fe3-8dd7-350883b35db1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.265001 Oct 06 04:33:40.828381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 155/282] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:40 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:41.013224 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:41.014195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:41.022419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:41.024862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:41.025607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:41.026527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:41.027235 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:41.027867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:41.033453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:41.034177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:41.044799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:41.046430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:41.046873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:41.047630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:41.057791 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:41.057791 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:41.285238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:41.295359 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-defbf41c-2af5-418d-a4ce-0d0f21268fe6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1321 microversion: 2.1 time: 0.265822 Oct 06 04:33:41.306991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:41.307283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 156/283] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:41 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:41.307283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:41.307283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:41.308153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:41.308794 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:41.308909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:41.309524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:41.310455 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:41.310666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:41.311394 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:41.311875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9005ccb9-b2d9-4ed2-b492-83dcc87d8b3a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.305834 Oct 06 04:33:41.312283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:41.312582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 128/284] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:41 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:41.509251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:41.519484 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f466d10b-8830-42ad-bd08-6a3bb5aed390 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1365 microversion: 2.1 time: 0.222030 Oct 06 04:33:41.520102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 157/285] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:41 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:41.850820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:41.852328 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:41.859041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:41.859522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:41.859956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:41.860667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:41.861085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:41.861503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:41.998519 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:42.006310 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-578aaa05-8b12-4154-b754-92fc726047b1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.159188 Oct 06 04:33:42.006886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 129/286] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:41 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:42.324084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:42.324693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:42.330843 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.331385 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.331851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.332789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.333441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.333877 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.337396 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:42.338518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:42.344612 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.345100 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.345535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.346235 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.346687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.347139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.486428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:42.488291 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:42.495680 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a2f98498-2a3d-4932-89e0-36268947d446 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1515 microversion: 2.1 time: 0.175402 Oct 06 04:33:42.496254 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 158/287] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:42 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:42.497526 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:42.502200 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:42.506683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:42.507938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5c51d1af-0550-476b-86e9-09d9a6353691 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.174558 Oct 06 04:33:42.508663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 130/288] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:42 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:42.520312 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:42.523561 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:42.530471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.531012 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.531496 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.532217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.532674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.533103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.542582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:42.543216 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:42.550727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.551499 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.552080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.553109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.553561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.554701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.605016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lazy-loading 'flavor' on Instance uuid d111c647-dca9-45d6-96c6-13169658cac9 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:33:42.711087 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:42.718662 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-37eefb37-5976-487f-aa49-5c8178057bc8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1553 microversion: 2.1 time: 0.180202 Oct 06 04:33:42.719245 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 131/289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:42 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:42.744275 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:42.745139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:42.753007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.753738 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.754260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.755228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.755881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.756503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.780400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-486fd177-02f3-4afb-9023-f7f17e70b119 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9/action" status: 200 len: 32 microversion: 2.1 time: 0.263727 Oct 06 04:33:42.781232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 159/290] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:33:42 2022] POST /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9/action => generated 32 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:33:42.792865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:42.793813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:42.800638 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.801216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.801639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.802373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.803015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.803439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.959197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-afc03c9d-adce-46fa-bed5-3d1ef48e0ceb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220015 Oct 06 04:33:42.960025 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 132/291] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 04:33:42 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:33:42.965494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-81f9d73a-4b2b-4c9b-9af2-d1ba8c684a9c req-501f7aa2-43b4-41c3-b465-b4bc46564200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c46bbc-e699-4b17-99e5-d6a70df92e2c", "name": "network-vif-plugged", "status": "completed", "tag": "542157e8-aced-4f6a-815d-a118c4b3ca2c"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:42.980677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-81f9d73a-4b2b-4c9b-9af2-d1ba8c684a9c req-501f7aa2-43b4-41c3-b465-b4bc46564200 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:42.981230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-81f9d73a-4b2b-4c9b-9af2-d1ba8c684a9c req-501f7aa2-43b4-41c3-b465-b4bc46564200 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:42.981759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-81f9d73a-4b2b-4c9b-9af2-d1ba8c684a9c req-501f7aa2-43b4-41c3-b465-b4bc46564200 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:42.995046 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-81f9d73a-4b2b-4c9b-9af2-d1ba8c684a9c req-501f7aa2-43b4-41c3-b465-b4bc46564200 service nova] Creating event network-vif-plugged:542157e8-aced-4f6a-815d-a118c4b3ca2c for instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c on hv-cinder-86022 Oct 06 04:33:43.000144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-81f9d73a-4b2b-4c9b-9af2-d1ba8c684a9c req-501f7aa2-43b4-41c3-b465-b4bc46564200 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038753 Oct 06 04:33:43.000933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 133/292] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:43.032136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:43.033467 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:43.040472 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:43.041215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:43.041868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:43.043002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:43.043618 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:43.047616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:43.193701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:43.204720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f473f48f-be0a-480c-897a-ac5482d80e49 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.178046 Oct 06 04:33:43.205531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 134/293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:43 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:43.414094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:43.423071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e431a12a-ab0e-4d96-98c5-33a1f3c0fbfd tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.634746 Oct 06 04:33:43.423900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 160/294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:42 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:43.533820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:43.535502 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:43.543437 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:43.544288 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:43.544973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:43.546002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:43.546866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:43.547662 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:43.759055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:43.771162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:43.773870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:43.775211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-109fe3ba-521e-4911-8e41-81c27d8fd831 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.246304 Oct 06 04:33:43.776471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 135/295] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:43 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:44.239932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:44.240604 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:44.248771 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:44.249286 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:44.250154 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:44.251216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:44.251657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:44.252518 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:44.452567 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:44.455230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:44.455397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:44.465565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ef2adb03-d319-43c6-ab5a-9810a53aa0c9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.234256 Oct 06 04:33:44.470013 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 161/296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:44 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:44.471472 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:44.473986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:44.474752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:44.475684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:44.477839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:44.478669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:44.595948 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-24207803-a2bd-4a63-a5bd-f308741f4bb3 req-9ad84ca4-00fb-4b24-9b22-2efc74ff4158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba369ba5-73dc-42d2-a375-b15b0e42188c", "tag": "6388b760-70f1-47b6-a577-dd35569e080b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:44.607043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-24207803-a2bd-4a63-a5bd-f308741f4bb3 req-9ad84ca4-00fb-4b24-9b22-2efc74ff4158 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:44.608056 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-24207803-a2bd-4a63-a5bd-f308741f4bb3 req-9ad84ca4-00fb-4b24-9b22-2efc74ff4158 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:44.608700 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-24207803-a2bd-4a63-a5bd-f308741f4bb3 req-9ad84ca4-00fb-4b24-9b22-2efc74ff4158 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:44.623355 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-24207803-a2bd-4a63-a5bd-f308741f4bb3 req-9ad84ca4-00fb-4b24-9b22-2efc74ff4158 service nova] Creating event network-changed:6388b760-70f1-47b6-a577-dd35569e080b for instance ba369ba5-73dc-42d2-a375-b15b0e42188c on hv-cinder-86022 Oct 06 04:33:44.630277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-24207803-a2bd-4a63-a5bd-f308741f4bb3 req-9ad84ca4-00fb-4b24-9b22-2efc74ff4158 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038365 Oct 06 04:33:44.631251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 162/297] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:33:44.672557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:44.688221 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b91d0ee3-1a4a-4497-91e3-185978277196 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.244981 Oct 06 04:33:44.697057 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 136/298] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:44 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:44.802061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:44.802753 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:44.809600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:44.810091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:44.810525 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:44.811257 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:44.811714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:44.812139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:44.957921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:44.968979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:44.971062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:44.973079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-81088b27-6b54-4e14-bf95-e8b9cadb5eb1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.174983 Oct 06 04:33:44.973793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 163/299] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:44 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:45.489294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:45.489900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:45.502575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:45.503090 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:45.511055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:45.512063 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:45.512752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:45.513329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:45.726626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:45.728014 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:45.738039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:45.739052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:45.740881 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:45.743227 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:45.743958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:45.744544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:45.745040 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:45.752948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-17ffe783-b0aa-4a15-80bc-24e8b93f5b04 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.267320 Oct 06 04:33:45.759481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 137/300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:45 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:45.999690 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:46.000300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:46.012525 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:46.015035 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:46.015384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:46.015820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:46.019127 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:46.019785 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:46.020904 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:46.027641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3fd30df8-eeb2-4a44-93ae-e86be038a2b8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.309410 Oct 06 04:33:46.039804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 164/301] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:45 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:46.430604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:46.443226 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:46.446058 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:46.447200 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9270aa1d-a142-4967-99dc-0c426c4ead9f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.453087 Oct 06 04:33:46.460108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 138/302] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:45 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:46.779366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:46.780820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:46.792061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:46.792597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:46.793539 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:46.794803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:46.795502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:46.796198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:47.055349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:47.057846 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:47.074406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:47.076235 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:47.077082 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:47.079547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:47.081710 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:47.083554 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:47.461228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:47.473616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-bc5c4e05-3b73-4dcf-a934-d333c1424831 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.425503 Oct 06 04:33:47.474368 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 139/303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:47 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:47.480199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:47.480342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:47.480802 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:47.487282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:47.487889 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:47.488322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:47.489080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:47.489843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:47.490029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-662b400e-0fa2-4272-8fd4-ed65546c06d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1363 microversion: 2.1 time: 0.714528 Oct 06 04:33:47.490444 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:47.491028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 165/304] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:46 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1363 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:47.635860 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:47.644165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:47.645609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:47.646708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-82fbe383-26b1-4e82-8687-7ea8b0b0f50e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.171277 Oct 06 04:33:47.647300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 140/305] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:47 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:48.502902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:48.503559 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:48.510023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.510506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.510939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.511661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.512392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.512540 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.517870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:48.519160 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:48.527244 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.527745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.528186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.528899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.529362 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.529789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.678764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:48.690432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f8507a0c-5a46-44d4-930e-fe8ef567db44 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1548 microversion: 2.1 time: 0.176692 Oct 06 04:33:48.691036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 141/306] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:48 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:48.701085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:48.701740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:48.711326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.711819 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.712260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.712966 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.713418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.713980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.819361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:48.829061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-73a78d01-8ca1-42a8-ac84-4347fb68eb25 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.329979 Oct 06 04:33:48.829774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 166/307] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:48 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:48.839553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:48.840033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:48.849413 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.849969 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.850469 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.851358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.851882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.852322 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.894181 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:48.903618 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:48.905237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:48.906312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9711d5db-382a-4af9-ad99-787d942443b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.210248 Oct 06 04:33:48.907212 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 142/308] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:48 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:48.911868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1565772468", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "networks": [{"uuid": "1983fdd1-b263-4e74-8c0a-f8ec327f5bd3"}]}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:48.932201 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7bfd3a9d-f923-411f-9789-19878d322795 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101107 Oct 06 04:33:48.932723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 167/309] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 04:33:48 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:48.939553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:48.940158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:48.947444 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.948023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.948694 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.949466 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:48.949991 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:48.950722 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:48.969097 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] validate_networks() for [('1983fdd1-b263-4e74-8c0a-f8ec327f5bd3', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:33:48.979829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:33:49.016372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:49.069201 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a03acf5d-23f0-4a71-ae74-8acac253ec9b tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 204 len: 0 microversion: 2.1 time: 0.132837 Oct 06 04:33:49.070838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 168/310] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:33:48 2022] DELETE /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:33:49.078972 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:49.079669 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:49.085693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:49.086255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:49.086691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:49.087420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:49.087873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:49.088295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:49.236067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:49.245249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b8dc2573-0495-4b3d-b4fc-048ca3a2a42c tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1554 microversion: 2.1 time: 0.170236 Oct 06 04:33:49.246046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 169/311] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:49 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:49.852404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:49.853735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:49.856767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:49.860635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:49.861121 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:49.861559 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:49.862267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:49.862724 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:49.863190 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:49.996016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:50.004158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8fd2233e-0e38-4564-83be-41c93a8c6f7c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.156206 Oct 06 04:33:50.004735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 170/312] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:49 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:50.009510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:50.010322 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:50.016492 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:50.016980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:50.017424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:50.018128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:50.018993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:50.019183 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:50.080718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:33:50.081346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:33:50.081907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:33:50.082372 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:33:50.082865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:33:50.092804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:50.093550 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:50.094133 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:50.095034 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:50.095643 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:50.096204 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:50.113930 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Getting quotas for project 250b86943e2d45dc992421c2adee42b2. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:33:50.119278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Getting quotas for user db187750f7514609923133b9a5f17ae7 and project 250b86943e2d45dc992421c2adee42b2. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:33:50.130479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:33:50.134108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:33:50.168808 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:50.177042 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:50.178618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:50.180697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-42fa8fd9-e8fa-4a8c-a2aa-bbb3294eda9c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.174753 Oct 06 04:33:50.181324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 171/313] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:50 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:50.197093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-27a04a02-72c8-4081-9ba4-6c841cf8bf17 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288478 Oct 06 04:33:50.204194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 143/314] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:33:50.209427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d69ccb20-838f-407d-8abb-79c3e9a67193 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:50.216652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d69ccb20-838f-407d-8abb-79c3e9a67193 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:50.269161 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:50.269861 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:50.274307 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d69ccb20-838f-407d-8abb-79c3e9a67193 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:50.276670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:50.277158 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:50.277828 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:50.278529 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:50.279003 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:50.280336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:50.281140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d69ccb20-838f-407d-8abb-79c3e9a67193 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1214 microversion: 2.1 time: 0.075465 Oct 06 04:33:50.295637 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 172/315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:50 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:50.525749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:50.535258 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-83f8e7f1-bff3-42df-a5de-f5ced35b7a77 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1554 microversion: 2.1 time: 0.270634 Oct 06 04:33:50.536014 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 144/316] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:50 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1554 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:50.695139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-a0c5ca36-1c71-480f-8baf-a3d47af20dda req-5c9c04c4-e8b9-4af1-83eb-a74f3b3e50ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc52256a-9199-4650-94d2-898dc19ce71d", "tag": "09cdf9f1-3de3-4c28-bc6f-d5c72cb9470e"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:50.705407 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-a0c5ca36-1c71-480f-8baf-a3d47af20dda req-5c9c04c4-e8b9-4af1-83eb-a74f3b3e50ae service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:50.705919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-a0c5ca36-1c71-480f-8baf-a3d47af20dda req-5c9c04c4-e8b9-4af1-83eb-a74f3b3e50ae service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:50.706352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-a0c5ca36-1c71-480f-8baf-a3d47af20dda req-5c9c04c4-e8b9-4af1-83eb-a74f3b3e50ae service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:50.718792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-a0c5ca36-1c71-480f-8baf-a3d47af20dda req-5c9c04c4-e8b9-4af1-83eb-a74f3b3e50ae service nova] Creating event network-changed:09cdf9f1-3de3-4c28-bc6f-d5c72cb9470e for instance dc52256a-9199-4650-94d2-898dc19ce71d on hv-cinder-86022 Oct 06 04:33:50.724646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-a0c5ca36-1c71-480f-8baf-a3d47af20dda req-5c9c04c4-e8b9-4af1-83eb-a74f3b3e50ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033317 Oct 06 04:33:50.725333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 173/317] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:51.028435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:51.029039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:51.034949 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:51.035462 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:51.035893 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:51.036585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:51.037042 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:51.037465 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:51.174139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:51.181925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c7d00ffb-5f1a-4926-8fdc-4fe478de28cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.157383 Oct 06 04:33:51.182505 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 145/318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:51 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:51.206080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:51.206769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:51.214057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:51.214551 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:51.215203 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:51.215916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:51.216464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:51.216900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:51.306403 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:51.307360 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:51.313834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:51.314330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:51.314811 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:51.315741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:51.316201 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:51.316616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:51.358867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:51.370699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:51.372783 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:51.374448 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f55005b1-1d90-41bd-8974-5541a8d03956 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1406 microversion: 2.20 time: 0.172515 Oct 06 04:33:51.379011 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 174/319] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:51 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:51.387036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:51.396508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ba890e70-32e5-441e-b5f2-7d121f877546 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1218 microversion: 2.1 time: 0.094957 Oct 06 04:33:51.397293 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 146/320] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:51 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:51.563019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:51.563642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:51.570787 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:51.571324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:51.571770 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:51.572471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:51.572928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:51.573358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:51.778568 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:51.786803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c8e9d45d-0533-4da8-bbf4-82ed6590b995 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1554 microversion: 2.1 time: 0.227586 Oct 06 04:33:51.787404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 175/321] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:51 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:52.205278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:52.205875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:52.212455 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.212940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.213431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.214132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.214609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.215051 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.342801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:52.350391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-44c0cfa6-ba9c-43f3-bc68-6ab541bb8ebb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.148957 Oct 06 04:33:52.351030 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 147/322] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:52 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:52.408055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:52.408830 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:52.416389 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.416876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.417306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.418006 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.418453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.418874 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.419981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:52.420602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:52.426570 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.427006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.427442 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.428134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.428582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.429570 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.488789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:52.497293 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f849210a-15af-4a46-a986-91d7d22e5cd6 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1218 microversion: 2.1 time: 0.081527 Oct 06 04:33:52.497864 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 148/323] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:52 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:52.552805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:52.561494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:52.562920 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:52.564079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-130162f7-ae41-4dd1-b708-d24a8fb4b920 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1598 microversion: 2.20 time: 0.160095 Oct 06 04:33:52.564620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 176/324] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:33:52 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:33:52.590463 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:52.590980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:52.596911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.597399 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.597876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.598548 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.599020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.599446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.603862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:52.679896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-55330567-c0b5-484a-9bb1-dd9c1d474bd6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092641 Oct 06 04:33:52.680487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 149/325] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Oct 6 04:33:52 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:33:52.810660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:52.811298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:52.817180 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.817697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.818141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.818835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:52.819316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:52.819921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:52.952422 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:52.963794 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-787b0993-47b9-4870-b0c8-e03418ed60fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1554 microversion: 2.1 time: 0.156894 Oct 06 04:33:52.964381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 177/326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:52 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:53.381715 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:53.385787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:53.393152 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:53.393595 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:53.394029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:53.394740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:53.395270 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:53.395974 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:53.519572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:53.520184 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:53.527243 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:53.527790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:53.528226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:53.528923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:53.529377 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:53.529802 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:53.613460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:53.629464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c8767c18-a175-46b1-80f8-a6e168b101a7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1266 microversion: 2.1 time: 0.113557 Oct 06 04:33:53.630412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 178/327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:53 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:53.652274 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:53.661730 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3ddcb3f6-92c5-4fad-bb10-844a9f4af6eb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.290347 Oct 06 04:33:53.668777 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 150/328] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:53 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:53.988604 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:53.989211 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:53.995761 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:53.996249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:53.996685 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:53.997380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:53.997834 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:53.998255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:54.131240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:54.140133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-32bfde3f-c10b-45f2-8c77-417570002fd9 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1554 microversion: 2.1 time: 0.155507 Oct 06 04:33:54.140771 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 179/329] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:53 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:54.293417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-f9e595fd-d1b0-49a7-b4bc-4cdc458bf504 req-74adc95e-d91b-48e1-982c-f96bfe9793c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c46bbc-e699-4b17-99e5-d6a70df92e2c", "tag": "542157e8-aced-4f6a-815d-a118c4b3ca2c"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:54.305131 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-f9e595fd-d1b0-49a7-b4bc-4cdc458bf504 req-74adc95e-d91b-48e1-982c-f96bfe9793c4 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:54.305833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-f9e595fd-d1b0-49a7-b4bc-4cdc458bf504 req-74adc95e-d91b-48e1-982c-f96bfe9793c4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:54.306439 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-f9e595fd-d1b0-49a7-b4bc-4cdc458bf504 req-74adc95e-d91b-48e1-982c-f96bfe9793c4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:54.324173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-f9e595fd-d1b0-49a7-b4bc-4cdc458bf504 req-74adc95e-d91b-48e1-982c-f96bfe9793c4 service nova] Creating event network-changed:542157e8-aced-4f6a-815d-a118c4b3ca2c for instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c on hv-cinder-86022 Oct 06 04:33:54.329421 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-f9e595fd-d1b0-49a7-b4bc-4cdc458bf504 req-74adc95e-d91b-48e1-982c-f96bfe9793c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040948 Oct 06 04:33:54.330348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 151/330] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:33:54.653796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:54.654976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:54.661296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:54.661955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:54.662460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:54.663492 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:54.664163 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:54.664801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:54.686815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:54.691149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:54.705708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:54.707993 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:54.708627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:54.709791 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:54.715377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:54.716102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:54.771587 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:54.781875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-07324547-a930-4112-a5c1-3042570d29de tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1272 microversion: 2.1 time: 0.132385 Oct 06 04:33:54.784084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 180/331] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:54 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:54.957296 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:54.966886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-40b7b064-f6fa-458c-891e-f0ab7e66f8c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.283861 Oct 06 04:33:54.968019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 152/332] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:54 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:55.172246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:55.174016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:55.182804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:55.184252 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:55.186446 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:55.198360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:55.199554 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:55.200168 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:55.265036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:55.265520 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:55.265948 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:55.266584 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lazy-loading 'fault' on Instance uuid 4f70ee71-4e29-4e3b-8073-d006f525c847 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:33:55.337117 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f29428b32454dbdb9c644759389abec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9baf342f94f34ae8f649db7198137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:55.349171 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-89be8f31-12ac-4c4f-97b9-ea321291e9db tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 200 len: 1350 microversion: 2.1 time: 0.184544 Oct 06 04:33:55.349726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 181/333] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:55 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 1350 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:55.805629 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:55.807637 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:55.815242 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:55.815734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:55.816171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:55.816873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:55.817494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:55.817914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:55.956059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:55.964266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6a306cf4-0bda-4a32-9b33-155c139fe6aa tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1314 microversion: 2.1 time: 0.161924 Oct 06 04:33:55.964787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 153/334] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:55 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:55.991781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:55.992396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:55.998510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:55.999055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:55.999502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.000208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.000853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.001290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.199656 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:56.207527 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-77a348b7-977c-45eb-9291-16bc92db0a36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.220135 Oct 06 04:33:56.208133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 182/335] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:55 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:56.242029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-632798fb-9055-435d-90d9-8b2bf8ee2bae req-6cb6ede8-d5fc-4488-aa0e-3467747b51b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421a8088-6baa-460d-b451-cb09dfa7bd36", "tag": "b031486f-0655-4510-94ff-6381ae70066e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:56.251497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-632798fb-9055-435d-90d9-8b2bf8ee2bae req-6cb6ede8-d5fc-4488-aa0e-3467747b51b8 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.251972 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-632798fb-9055-435d-90d9-8b2bf8ee2bae req-6cb6ede8-d5fc-4488-aa0e-3467747b51b8 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.252395 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-632798fb-9055-435d-90d9-8b2bf8ee2bae req-6cb6ede8-d5fc-4488-aa0e-3467747b51b8 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.281287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-632798fb-9055-435d-90d9-8b2bf8ee2bae req-6cb6ede8-d5fc-4488-aa0e-3467747b51b8 service nova] Creating event network-changed:b031486f-0655-4510-94ff-6381ae70066e for instance 421a8088-6baa-460d-b451-cb09dfa7bd36 on hv-cinder-86022 Oct 06 04:33:56.286224 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-632798fb-9055-435d-90d9-8b2bf8ee2bae req-6cb6ede8-d5fc-4488-aa0e-3467747b51b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048301 Oct 06 04:33:56.287053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 154/336] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:56.360213 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-38e08d36-4604-41d7-bc44-4264f872cbec req-efe3c95d-af0c-45f9-a14f-bbb51e4efd8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f70ee71-4e29-4e3b-8073-d006f525c847", "name": "network-vif-deleted", "tag": "82231974-6803-4127-b9f5-c7ea01ea019f"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:33:56.370156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-38e08d36-4604-41d7-bc44-4264f872cbec req-efe3c95d-af0c-45f9-a14f-bbb51e4efd8c service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.370721 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-38e08d36-4604-41d7-bc44-4264f872cbec req-efe3c95d-af0c-45f9-a14f-bbb51e4efd8c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.371317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-38e08d36-4604-41d7-bc44-4264f872cbec req-efe3c95d-af0c-45f9-a14f-bbb51e4efd8c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.375240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:56.375931 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:56.382826 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.383406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.383832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.384164 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-38e08d36-4604-41d7-bc44-4264f872cbec req-efe3c95d-af0c-45f9-a14f-bbb51e4efd8c service nova] Creating event network-vif-deleted:82231974-6803-4127-b9f5-c7ea01ea019f for instance 4f70ee71-4e29-4e3b-8073-d006f525c847 on hv-cinder-86022 Oct 06 04:33:56.384573 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.385029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.385447 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.389329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-38e08d36-4604-41d7-bc44-4264f872cbec req-efe3c95d-af0c-45f9-a14f-bbb51e4efd8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 Oct 06 04:33:56.390088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 183/337] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:33:56.400291 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] HTTP exception thrown: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Request method failure captured: Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 HTTP/1.1 Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpal7sf-2fimwD2-WFlD-_bgB_CfYXAg9k6o9l0kBHTEDrdfZbL0M4jQYPqhyywvdaO422gwzOAleIbWo2HlZ9zCp1DDV-JEXqNo2FiMoI4q5pYQmANeRuiCOCzKUcOV_2kyY578gsamc78iWqhN_zjVgMvD1OQhygLhxdehubj9_Q Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 93b9baf342f94f34ae8f649db7198137 Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:33:56.404879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93b9baf342f94f34ae8f649db7198137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 93b9baf342f94f34ae8f649db7198137 Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-DeleteServersTestJSON-320233833-project Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: 4f29428b32454dbdb9c644759389abec Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-DeleteServersTestJSON-320233833-project Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.406147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '4f70ee71-4e29-4e3b-8073-d006f525c847'} Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:33:56.406944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.408129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.409178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Returning 404 to user: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:33:56.409178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8ad56d08-162d-4c48-a9cb-7d746c127c45 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 404 len: 111 microversion: 2.1 time: 0.035435 Oct 06 04:33:56.409178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 155/338] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:56 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:33:56.522599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:56.524855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:56.530918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.531428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.531861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.532549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.533000 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.533800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.546830 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] HTTP exception thrown: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Request method failure captured: Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847/os-volume_attachments HTTP/1.1 Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpal7sf-2fimwD2-WFlD-_bgB_CfYXAg9k6o9l0kBHTEDrdfZbL0M4jQYPqhyywvdaO422gwzOAleIbWo2HlZ9zCp1DDV-JEXqNo2FiMoI4q5pYQmANeRuiCOCzKUcOV_2kyY578gsamc78iWqhN_zjVgMvD1OQhygLhxdehubj9_Q Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 93b9baf342f94f34ae8f649db7198137 Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:33:56.550814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93b9baf342f94f34ae8f649db7198137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 93b9baf342f94f34ae8f649db7198137 Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-DeleteServersTestJSON-320233833-project Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 4f29428b32454dbdb9c644759389abec Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-DeleteServersTestJSON-320233833-project Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.552296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'server_id': '4f70ee71-4e29-4e3b-8073-d006f525c847'} Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:33:56.553138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:56.555730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:56.557255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Returning 404 to user: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:33:56.557255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-80489bd2-9943-47fb-a4a2-51332f9eb1f0 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034052 Oct 06 04:33:56.557715 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 184/339] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:33:56 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:33:56.987293 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:56.987816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:56.995437 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.995915 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.996385 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:56.997074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:56.997525 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:56.997946 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:57.130792 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:57.138664 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8bef90f7-94a3-492f-ad36-bba110e3964b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1314 microversion: 2.1 time: 0.155488 Oct 06 04:33:57.139290 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 156/340] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:56 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:57.233671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:57.234297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:57.240376 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:57.240800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:57.241929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:57.243049 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:57.243513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:57.243940 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:57.370133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:57.377739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-13f07209-0a20-46dd-adae-224097069095 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.147931 Oct 06 04:33:57.378294 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 185/341] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:57 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:57.759464 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:57.759965 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:57.765858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:57.766346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:57.766788 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:57.767512 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:57.767973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:57.768402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:57.782654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] HTTP exception thrown: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Request method failure captured: Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: DELETE /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 HTTP/1.1 Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpal7sf-2fimwD2-WFlD-_bgB_CfYXAg9k6o9l0kBHTEDrdfZbL0M4jQYPqhyywvdaO422gwzOAleIbWo2HlZ9zCp1DDV-JEXqNo2FiMoI4q5pYQmANeRuiCOCzKUcOV_2kyY578gsamc78iWqhN_zjVgMvD1OQhygLhxdehubj9_Q Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 93b9baf342f94f34ae8f649db7198137 Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:33:57.784237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93b9baf342f94f34ae8f649db7198137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 93b9baf342f94f34ae8f649db7198137 Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-DeleteServersTestJSON-320233833-project Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: 4f29428b32454dbdb9c644759389abec Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-DeleteServersTestJSON-320233833-project Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.785718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '4f70ee71-4e29-4e3b-8073-d006f525c847'} Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:33:57.786479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.787815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.789641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Returning 404 to user: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:33:57.789641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-40b93a0c-83c8-4a9d-a8f7-3aac99e008b1 tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 404 len: 111 microversion: 2.1 time: 0.030719 Oct 06 04:33:57.789641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 157/342] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:33:57 2022] DELETE /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:33:57.793878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:57.794488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] [instance: 4f70ee71-4e29-4e3b-8073-d006f525c847] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:57.800378 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:57.800857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:57.801292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:57.801982 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:57.802436 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:57.802862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:57.815815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] HTTP exception thrown: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Request method failure captured: Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 HTTP/1.1 Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpal7sf-2fimwD2-WFlD-_bgB_CfYXAg9k6o9l0kBHTEDrdfZbL0M4jQYPqhyywvdaO422gwzOAleIbWo2HlZ9zCp1DDV-JEXqNo2FiMoI4q5pYQmANeRuiCOCzKUcOV_2kyY578gsamc78iWqhN_zjVgMvD1OQhygLhxdehubj9_Q Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 93b9baf342f94f34ae8f649db7198137 Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:33:57.817918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93b9baf342f94f34ae8f649db7198137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93b9baf342f94f34ae8f649db7198137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 93b9baf342f94f34ae8f649db7198137 Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-DeleteServersTestJSON-320233833 Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-DeleteServersTestJSON-320233833-project Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 4f29428b32454dbdb9c644759389abec Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-DeleteServersTestJSON-320233833-project Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.821786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '4f70ee71-4e29-4e3b-8073-d006f525c847'} Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:33:57.822739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. Oct 06 04:33:57.824088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:33:57.825250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] Returning 404 to user: Instance 4f70ee71-4e29-4e3b-8073-d006f525c847 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:33:57.825250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-11413436-a557-4a0a-8371-f693b2bd05fa tempest-DeleteServersTestJSON-320233833 tempest-DeleteServersTestJSON-320233833-project] 10.222.0.33 "GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847" status: 404 len: 111 microversion: 2.1 time: 0.029254 Oct 06 04:33:57.825250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 186/343] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:57 2022] GET /compute/v2.1/servers/4f70ee71-4e29-4e3b-8073-d006f525c847 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:33:58.161796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:58.163201 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:58.171851 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:58.172345 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:58.172818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:58.174653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:58.174653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:58.174653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:58.401367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:58.401988 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:58.408716 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:58.409214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:58.409652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:58.410375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:58.410839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:58.411299 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:58.571525 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:58.579957 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-97ee9ff9-9d70-4fe2-bb93-72e38babe803 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1314 microversion: 2.1 time: 0.422628 Oct 06 04:33:58.580672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 158/344] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:58 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:33:58.728899 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:58.736457 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-be7c854d-f7f5-49d0-ae68-0697d35cbbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.339575 Oct 06 04:33:58.737014 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 187/345] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:58 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:33:59.604985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:59.605677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:59.612187 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:59.612679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:59.613104 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:59.613810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:59.614256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:59.615075 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:59.760352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:33:59.761036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:33:59.767278 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:59.767704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:59.768140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:59.768846 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:33:59.769298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:33:59.769723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:33:59.774018 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:33:59.806404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:33:59.818285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-11051f01-c9fd-431b-83fd-56a8e7adbd71 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1314 microversion: 2.1 time: 0.217342 Oct 06 04:33:59.827086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 159/346] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:59 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:00.048417 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:00.058541 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-de0bdac7-e33c-46dd-b983-d359c22a7e20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.302562 Oct 06 04:34:00.062895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 188/347] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:33:59 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:00.843746 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:00.844270 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:00.847422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:00.852006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:00.861201 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:00.861699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:00.862134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:00.862841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:00.863537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:00.863964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:01.088090 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:01.088687 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:01.090685 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:01.096466 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:01.097491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:01.098186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:01.099078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:01.099696 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:01.100144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:01.215077 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:01.234234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fce233c3-4a41-4f37-bed3-6fcc785eacd2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1314 microversion: 2.1 time: 0.394572 Oct 06 04:34:01.235441 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 160/348] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:00 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:01.581484 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:01.606126 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bc9b9153-46a7-482f-9684-bb4cc3eba5af tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.522017 Oct 06 04:34:01.610667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 189/349] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:01 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:01.858039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-3f649c46-15f7-461a-a1cc-0065f813e550 req-e122a2cf-b488-4a85-94e1-ae8429ce1d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421a8088-6baa-460d-b451-cb09dfa7bd36", "name": "network-vif-plugged", "status": "completed", "tag": "b031486f-0655-4510-94ff-6381ae70066e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:01.872029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3f649c46-15f7-461a-a1cc-0065f813e550 req-e122a2cf-b488-4a85-94e1-ae8429ce1d45 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:01.872575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3f649c46-15f7-461a-a1cc-0065f813e550 req-e122a2cf-b488-4a85-94e1-ae8429ce1d45 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:01.873005 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3f649c46-15f7-461a-a1cc-0065f813e550 req-e122a2cf-b488-4a85-94e1-ae8429ce1d45 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:01.888084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-3f649c46-15f7-461a-a1cc-0065f813e550 req-e122a2cf-b488-4a85-94e1-ae8429ce1d45 service nova] Creating event network-vif-plugged:b031486f-0655-4510-94ff-6381ae70066e for instance 421a8088-6baa-460d-b451-cb09dfa7bd36 on hv-cinder-86022 Oct 06 04:34:01.894391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-3f649c46-15f7-461a-a1cc-0065f813e550 req-e122a2cf-b488-4a85-94e1-ae8429ce1d45 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045598 Oct 06 04:34:01.895606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 161/350] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:02.260963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:02.262176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:02.269668 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:02.270319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:02.270858 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:02.272045 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:02.273995 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:02.274829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:02.562084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:02.570933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b7ceac1e-0109-4603-ae5a-50dc7054318a tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1314 microversion: 2.1 time: 0.315217 Oct 06 04:34:02.571537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 190/351] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:02 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:02.640875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:02.641598 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:02.661685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:02.662220 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:02.662654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:02.663491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:02.664099 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:02.664497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:02.869858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:02.877565 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-147e4194-6e54-42fd-a7a1-e66ba602e23e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.246159 Oct 06 04:34:02.878149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 162/352] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:02 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:03.593845 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:03.594382 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:03.601738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:03.602238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:03.602664 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:03.603406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:03.603861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:03.604283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:03.745054 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:03.753683 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ae32f7a6-4ca9-47be-bfcc-14b5b7163b69 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1314 microversion: 2.1 time: 0.163167 Oct 06 04:34:03.754688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 191/353] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:03 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:03.763965 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0f028317-fd87-4f5e-ba15-961486a7c605 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Action: 'create', calling method: .version_select at 0x7f0c42c1dca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2058406056"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:03.876454 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-219623076", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "networks": [{"uuid": "d5ebc260-c361-42d8-80fe-e4538974d21b"}]}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:03.933869 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] validate_networks() for [('d5ebc260-c361-42d8-80fe-e4538974d21b', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:34:04.062290 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0f028317-fd87-4f5e-ba15-961486a7c605 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.420583 Oct 06 04:34:04.063389 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 163/354] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Oct 6 04:34:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 422 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 06 04:34:04.067418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:04.068025 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:04.075198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:04.075975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:04.076440 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:04.077147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:04.077570 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:04.077993 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:04.229959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:04.237955 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-97e74238-8e0d-4314-a96e-a9339866f09e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.174034 Oct 06 04:34:04.250981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 164/355] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:04 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:04.250981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6e7eb0fb-2c88-4cc5-8069-1735c71e8361 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c1d4c0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:04.295818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6e7eb0fb-2c88-4cc5-8069-1735c71e8361 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3" status: 200 len: 345 microversion: 2.1 time: 0.055211 Oct 06 04:34:04.296486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 165/356] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:34:04 2022] GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:04.324160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:34:04.324586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:34:04.325083 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:34:04.325496 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:34:04.325916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:34:04.335407 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:04.336425 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:04.336872 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:04.337610 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:04.338070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:04.338543 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:04.356160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Getting quotas for project d951f19622f24014b0db552eafd4346d. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:34:04.360156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Getting quotas for user 1bd18015d8334028ada90e42558d7942 and project d951f19622f24014b0db552eafd4346d. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:34:04.371833 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:34:04.374114 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:34:04.421865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d4be9fd2-f3cd-4294-874d-6476a0a768fb tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548925 Oct 06 04:34:04.422529 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 192/357] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 04:34:04.434277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-dd670186-029d-4809-924e-11f9fa75ff81 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:04.435059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-dd670186-029d-4809-924e-11f9fa75ff81 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:04.500174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-dd670186-029d-4809-924e-11f9fa75ff81 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:04.509112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-dd670186-029d-4809-924e-11f9fa75ff81 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1218 microversion: 2.1 time: 0.078780 Oct 06 04:34:04.509674 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 166/358] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:04 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:04.784299 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:04.785440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:04.793728 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:04.794414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:04.794851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:04.795639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:04.796099 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:04.796535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:04.936327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:04.945171 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1d4c8f0a-79d8-4144-b1f8-138705de4d50 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1498 microversion: 2.1 time: 0.171629 Oct 06 04:34:04.945745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 193/359] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:04 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:05.262547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:05.263202 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:05.269410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:05.269896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:05.270329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:05.271064 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:05.271487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:05.271909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:05.310983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-78c388f9-c923-4953-bcd0-5ea17e9aaf35 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c5d790>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:05.425687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:05.434278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-12693676-939d-4162-958c-ff893c2ae273 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.175689 Oct 06 04:34:05.434863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 167/360] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:05 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:05.501730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-78c388f9-c923-4953-bcd0-5ea17e9aaf35 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3" status: 200 len: 346 microversion: 2.1 time: 0.194347 Oct 06 04:34:05.502339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 194/361] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:34:05 2022] GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 => generated 346 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:34:05.515887 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-af71d3a3-e362-4d0c-800c-2032c2a877a6 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Action: 'create', calling method: .version_select at 0x7f0c42da8430>, body: {"snapshot": {"volume_id": "f570da63-926c-4109-8114-65444c96aed3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-252905588"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:05.532234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:05.533055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:05.541681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:05.542331 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:05.542915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:05.543788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:05.544387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:05.545023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:05.610708 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:05.620041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f7f4ec15-3fee-4b7f-9b43-4fb941008f92 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1270 microversion: 2.1 time: 0.091369 Oct 06 04:34:05.621048 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 195/362] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:05 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:05.625588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:05.626090 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:05.632143 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:05.632624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:05.633116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:05.633733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:05.634485 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:05.634933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:05.661428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:34:05.693556 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-af71d3a3-e362-4d0c-800c-2032c2a877a6 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.181479 Oct 06 04:34:05.694909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 168/363] 10.222.0.33 () {60 vars in 1162 bytes} [Thu Oct 6 04:34:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:05.706142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-99606e74-5d07-4c8b-a179-1e29169d13f8 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42ce9160>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:05.737813 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-99606e74-5d07-4c8b-a179-1e29169d13f8 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 200 len: 286 microversion: 2.1 time: 0.035775 Oct 06 04:34:05.738348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 169/364] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:05 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:05.747117 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cedf7035-80f2-4ca3-bc26-f456559efa8b tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "DELETE /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 204 len: 0 microversion: 2.1 time: 0.124691 Oct 06 04:34:05.747693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 196/365] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:34:05 2022] DELETE /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:34:05.750670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7b447b61-5d72-4561-b2ef-eb79112bcba6 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42e85280>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:05.756386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:05.757782 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:05.763654 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:05.764133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:05.764560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:05.765250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:05.765696 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:05.766114 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:05.784462 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7b447b61-5d72-4561-b2ef-eb79112bcba6 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037339 Oct 06 04:34:05.785234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 170/366] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Oct 6 04:34:05 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:05.801087 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-de0e54ed-bbcf-44a1-aa53-55f906a79e07 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42e859d0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:05.834086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-de0e54ed-bbcf-44a1-aa53-55f906a79e07 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 200 len: 286 microversion: 2.1 time: 0.036650 Oct 06 04:34:05.835281 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 171/367] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:05 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:34:05.910439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:05.918480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-904f3de4-63cb-4ae7-ab33-22d859bf3544 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1504 microversion: 2.1 time: 0.166368 Oct 06 04:34:05.919061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 197/368] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:05 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:06.458687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:06.459310 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:06.465875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:06.466352 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:06.466780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:06.467490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:06.467941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:06.468369 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:06.596205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:06.605000 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1e51d7cd-e19f-4495-b86b-c96f34c0354e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.150659 Oct 06 04:34:06.605563 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 172/369] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:06 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:06.644335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:06.644938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:06.651321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:06.651798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:06.652226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:06.652908 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:06.653356 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:06.653776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:06.713590 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:06.723005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ed9c3dc5-c93f-4941-91f2-0de32d038f0f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1278 microversion: 2.1 time: 0.082376 Oct 06 04:34:06.723578 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 198/370] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:06 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:06.847970 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1a31e3a3-c5fc-4fd0-bd2a-daa3fb493e81 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42d494c0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:06.877670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1a31e3a3-c5fc-4fd0-bd2a-daa3fb493e81 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 200 len: 286 microversion: 2.1 time: 0.033658 Oct 06 04:34:06.878212 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 173/371] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:06 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:06.941247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:06.941853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:06.948332 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:06.948812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:06.949246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:06.949930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:06.950377 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:06.950801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:07.084279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:07.092796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1eb9ca06-c18f-49f7-9399-fc8d4400f3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1504 microversion: 2.1 time: 0.155328 Oct 06 04:34:07.093364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 199/372] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:06 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:07.628379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:07.629015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:07.631312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:07.638710 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:07.639238 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:07.639678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:07.640393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:07.640843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:07.641267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:07.752943 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:07.753600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:07.762629 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:07.763483 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:07.764218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:07.765371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:07.766123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:07.766844 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:07.782910 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:07.792299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-59028084-689f-457a-9322-376ffe5f5886 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.168164 Oct 06 04:34:07.792878 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 174/373] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:07 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:07.834033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:07.842711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d663f6c4-d0c9-4876-a444-8ffa4ae47532 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1278 microversion: 2.1 time: 0.099551 Oct 06 04:34:07.843374 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 200/374] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:07 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:07.892531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f6b7e54c-fe3f-4e9f-ac2e-74b7f1c8959a tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42e85c10>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:07.924267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f6b7e54c-fe3f-4e9f-ac2e-74b7f1c8959a tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 200 len: 286 microversion: 2.1 time: 0.036754 Oct 06 04:34:07.924822 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 175/375] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:07 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:08.121502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:08.122298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:08.128525 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:08.129005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:08.129435 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:08.130126 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:08.130574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:08.131014 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:08.258343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:08.266039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-dfb4e32c-1f69-4b90-af98-3f45b4c44716 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1504 microversion: 2.1 time: 0.148710 Oct 06 04:34:08.266741 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 201/376] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:08 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:08.817583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:08.818191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:08.824178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:08.824660 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:08.825093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:08.825786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:08.826236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:08.826659 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:08.865405 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:08.866218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:08.872486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:08.872973 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:08.873408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:08.874109 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:08.874561 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:08.875013 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:08.936189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:08.943642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4a0217b8-10c2-4c30-be04-d63876d33545 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1278 microversion: 2.1 time: 0.081972 Oct 06 04:34:08.944268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 202/377] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:08 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:08.948711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c5c7cc45-8474-42a3-b794-5a45f458a944 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c22820>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:08.958348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:08.972435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-30f28412-f386-4fda-8396-f3a9dcd9b771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.158936 Oct 06 04:34:08.973494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 176/378] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:08 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:08.981774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c5c7cc45-8474-42a3-b794-5a45f458a944 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 200 len: 286 microversion: 2.1 time: 0.036420 Oct 06 04:34:08.982345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 203/379] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:08 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:09.289289 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:09.289893 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:09.295819 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:09.296300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:09.296733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:09.297419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:09.297869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:09.298287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:09.426755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:09.434895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ca9e86a1-5ffa-437a-8f93-682b86d467fd tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1504 microversion: 2.1 time: 0.149515 Oct 06 04:34:09.435475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 177/380] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:09 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:09.977067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:09.977672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:09.983593 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:09.984071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:09.984503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:09.985188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:09.985635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:09.986053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:09.994565 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b5a49348-c666-48b1-810f-8646b3a1a998 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42cf71f0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:10.027164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b5a49348-c666-48b1-810f-8646b3a1a998 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 200 len: 286 microversion: 2.1 time: 0.037338 Oct 06 04:34:10.029178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 178/381] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:09 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:34:10.032169 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:10.032765 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:10.039378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:10.039862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:10.040291 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:10.040979 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:10.041425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:10.041863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:10.055110 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:10.060642 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:10.063443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a5503fca-2d56-48da-a623-7654a85ab7fe tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1278 microversion: 2.1 time: 0.090785 Oct 06 04:34:10.064039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 204/382] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:09 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:10.170163 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:10.177803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c9e6340b-c095-41ca-810b-d3df2649ef78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.149158 Oct 06 04:34:10.178388 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 179/383] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:10 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:10.457307 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:10.457917 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:10.464326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:10.464810 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:10.465246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:10.466225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:10.466686 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:10.467141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:10.592807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:10.596296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:10.601155 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-78e16e66-62f2-40be-93b0-9b3736d4359f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1504 microversion: 2.1 time: 0.147737 Oct 06 04:34:10.601719 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 205/384] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:10 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:11.039704 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8a9a4092-bf9c-4635-b582-97f44a94d607 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42dc7e50>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:11.071701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8a9a4092-bf9c-4635-b582-97f44a94d607 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 200 len: 287 microversion: 2.1 time: 0.036139 Oct 06 04:34:11.072263 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 180/385] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:11 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:11.085418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5ab4fef2-2aaa-4aa7-90d2-366cb5b00665 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c5d670>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:11.085922 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:11.093963 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:11.100860 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:11.101294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:11.101809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:11.102657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:11.103275 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:11.103847 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:11.167290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5ab4fef2-2aaa-4aa7-90d2-366cb5b00665 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 202 len: 0 microversion: 2.1 time: 0.087233 Oct 06 04:34:11.167868 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 206/386] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Oct 6 04:34:11 2022] DELETE /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:34:11.169835 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:11.176008 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-42c242fd-77e8-4f44-8e5b-56143c223203 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c1d940>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:11.179800 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5266dc45-45f8-4e36-bc1b-887dfac78e77 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1276 microversion: 2.1 time: 0.096753 Oct 06 04:34:11.196517 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 181/387] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:11 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:11.201676 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:11.202383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:11.215132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:11.215384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-42c242fd-77e8-4f44-8e5b-56143c223203 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 200 len: 286 microversion: 2.1 time: 0.043199 Oct 06 04:34:11.215766 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:11.216145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 207/388] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:11 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:34:11.216361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:11.217714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:11.217714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:11.218079 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:11.364033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:11.373433 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5d50d41a-48fa-47de-af60-ed61a14f58bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.175527 Oct 06 04:34:11.374007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 182/389] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:11 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:11.624012 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:11.624631 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:11.631573 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:11.632554 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:11.632992 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:11.633791 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:11.634287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:11.634713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:11.774309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:11.782069 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ad67ce8f-c503-4752-a96b-83f0c1ea7c4c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1504 microversion: 2.1 time: 0.161932 Oct 06 04:34:11.782635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 208/390] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:11 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:12.205498 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:12.207361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:12.233793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-18d186e7-9642-45e3-86c5-fe906e8696b2 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c5d4c0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:12.239376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.240083 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.242137 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.243888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.244640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.245441 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.280144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-18d186e7-9642-45e3-86c5-fe906e8696b2 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] HTTP exception thrown: Snapshot c7d21aed-b12c-4858-a53e-0054c0630936 could not be found. Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-18d186e7-9642-45e3-86c5-fe906e8696b2 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Request method failure captured: Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 HTTP/1.1 Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlq7kh3b1zujysi9FngaC1w5y4jHqxZQ5Roa_vh5Sdyc0jp5r5wO9Mg8B8noYmMYHyhrZ0jZcghYQuiohw2XInsEOc0kmst6V7Vy29mAhT8qqB5cFPHq6x12JmBPwobHYI1Wl9rQ8bui3Aq0qFGaHX7psXzwyBUKQycVRWRicm8Fhmg Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: e0af60ab182841269cee39048e22984d Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:34:12.282675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0af60ab182841269cee39048e22984d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0af60ab182841269cee39048e22984d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0af60ab182841269cee39048e22984d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0af60ab182841269cee39048e22984d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: e0af60ab182841269cee39048e22984d Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesSnapshotsTestJSON-1481671830-project Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: b4d39c850b024bde8e69665a85f09d8a Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481671830-project Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Snapshot c7d21aed-b12c-4858-a53e-0054c0630936 could not be found. Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'c7d21aed-b12c-4858-a53e-0054c0630936'} Oct 06 04:34:12.283954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c7d21aed-b12c-4858-a53e-0054c0630936 could not be found. (HTTP 404) (Request-ID: req-b5df1415-e6d5-4c00-9c0b-58549d3edfe0) Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:12.284689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:34:12.286222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c7d21aed-b12c-4858-a53e-0054c0630936 could not be found. Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 06 04:34:12.287293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c7d21aed-b12c-4858-a53e-0054c0630936 could not be found. Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c7d21aed-b12c-4858-a53e-0054c0630936 could not be found. Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-18d186e7-9642-45e3-86c5-fe906e8696b2 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Returning 404 to user: Snapshot c7d21aed-b12c-4858-a53e-0054c0630936 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:34:12.290801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-18d186e7-9642-45e3-86c5-fe906e8696b2 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936" status: 404 len: 111 microversion: 2.1 time: 0.059650 Oct 06 04:34:12.291929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 209/391] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Oct 6 04:34:12 2022] GET /compute/v2.1/os-snapshots/c7d21aed-b12c-4858-a53e-0054c0630936 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:34:12.296915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a6647d0a-733c-4f91-9743-ee43aa1cd7cd tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c1d9d0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:12.389943 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a6647d0a-733c-4f91-9743-ee43aa1cd7cd tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3" status: 202 len: 0 microversion: 2.1 time: 0.098024 Oct 06 04:34:12.391030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 210/392] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:34:12 2022] DELETE /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:34:12.396743 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-1dc7d98f-469e-4fce-9220-8e9fb305d4aa req-7ad3faf5-26ff-4990-a517-24c8364905bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421a8088-6baa-460d-b451-cb09dfa7bd36", "name": "network-vif-deleted", "tag": "b031486f-0655-4510-94ff-6381ae70066e"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:12.409747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-1dc7d98f-469e-4fce-9220-8e9fb305d4aa req-7ad3faf5-26ff-4990-a517-24c8364905bc service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.411014 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-1dc7d98f-469e-4fce-9220-8e9fb305d4aa req-7ad3faf5-26ff-4990-a517-24c8364905bc service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.411693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-1dc7d98f-469e-4fce-9220-8e9fb305d4aa req-7ad3faf5-26ff-4990-a517-24c8364905bc service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.432613 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-1dc7d98f-469e-4fce-9220-8e9fb305d4aa req-7ad3faf5-26ff-4990-a517-24c8364905bc service nova] Creating event network-vif-deleted:b031486f-0655-4510-94ff-6381ae70066e for instance 421a8088-6baa-460d-b451-cb09dfa7bd36 on hv-cinder-86022 Oct 06 04:34:12.439994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-1dc7d98f-469e-4fce-9220-8e9fb305d4aa req-7ad3faf5-26ff-4990-a517-24c8364905bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047508 Oct 06 04:34:12.440647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 211/393] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:12.446277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:12.447330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:12.448538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:12.454550 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-394fad8f-bb51-43cb-ab66-cf3803597275 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1318 microversion: 2.1 time: 0.254957 Oct 06 04:34:12.455665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 183/394] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:12 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:12.457387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.458152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.458606 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.459456 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.459928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.460364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.462030 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-069f3304-95ba-4d15-820c-f402719d45ce tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c1dca0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:12.520414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-069f3304-95ba-4d15-820c-f402719d45ce tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3" status: 200 len: 345 microversion: 2.1 time: 0.063476 Oct 06 04:34:12.520979 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 184/395] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:34:12 2022] GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:12.682672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-1f9861ff-2128-48c4-9eea-abaae3d35029 req-2a5c0212-353d-4f9d-b196-0f1175825213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304e35c3-5e47-4f8b-abf1-ac65e8ebe723", "tag": "0b629cb4-849e-443b-9802-793f64a0c62e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:12.682823 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:12.694400 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1f9861ff-2128-48c4-9eea-abaae3d35029 req-2a5c0212-353d-4f9d-b196-0f1175825213 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.695449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1f9861ff-2128-48c4-9eea-abaae3d35029 req-2a5c0212-353d-4f9d-b196-0f1175825213 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.696046 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1f9861ff-2128-48c4-9eea-abaae3d35029 req-2a5c0212-353d-4f9d-b196-0f1175825213 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.701981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4efa5542-0fb5-4efc-b854-32ddf2bfc834 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.259713 Oct 06 04:34:12.714984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 212/396] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:12 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:12.724881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-1f9861ff-2128-48c4-9eea-abaae3d35029 req-2a5c0212-353d-4f9d-b196-0f1175825213 service nova] Creating event network-changed:0b629cb4-849e-443b-9802-793f64a0c62e for instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 on hv-cinder-86022 Oct 06 04:34:12.730785 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-1f9861ff-2128-48c4-9eea-abaae3d35029 req-2a5c0212-353d-4f9d-b196-0f1175825213 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052386 Oct 06 04:34:12.731727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 185/397] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:34:12.805455 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:12.806195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:12.813194 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.813630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.814039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.815113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.815621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.816055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.844765 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:12.849878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:12.850858 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:12.851327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:12.851770 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lazy-loading 'fault' on Instance uuid 421a8088-6baa-460d-b451-cb09dfa7bd36 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:34:12.900311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:12.907852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d19dc5ec-cf3e-405f-9d61-777e521340e8 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 200 len: 1304 microversion: 2.1 time: 0.107014 Oct 06 04:34:12.908424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 213/398] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:12 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:13.482429 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:13.483174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:13.489158 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:13.489637 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:13.490066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:13.490823 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:13.491310 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:13.491733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:13.534885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b80480c6-7872-4072-9531-91373b703b0b tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42bed9d0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:13.566423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-b80480c6-7872-4072-9531-91373b703b0b tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] HTTP exception thrown: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b80480c6-7872-4072-9531-91373b703b0b tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Request method failure captured: Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 HTTP/1.1 Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlq7kh3b1zujysi9FngaC1w5y4jHqxZQ5Roa_vh5Sdyc0jp5r5wO9Mg8B8noYmMYHyhrZ0jZcghYQuiohw2XInsEOc0kmst6V7Vy29mAhT8qqB5cFPHq6x12JmBPwobHYI1Wl9rQ8bui3Aq0qFGaHX7psXzwyBUKQycVRWRicm8Fhmg Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: e0af60ab182841269cee39048e22984d Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:34:13.568503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0af60ab182841269cee39048e22984d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0af60ab182841269cee39048e22984d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0af60ab182841269cee39048e22984d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0af60ab182841269cee39048e22984d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: e0af60ab182841269cee39048e22984d Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesSnapshotsTestJSON-1481671830-project Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: b4d39c850b024bde8e69665a85f09d8a Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481671830-project Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'f570da63-926c-4109-8114-65444c96aed3'} Oct 06 04:34:13.570512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. (HTTP 404) (Request-ID: req-44d86051-635b-41c8-b8ff-841d71c87032) Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.571494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:34:13.572758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 04:34:13.574658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.575945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.577335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b80480c6-7872-4072-9531-91373b703b0b tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Returning 404 to user: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:34:13.578170 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b80480c6-7872-4072-9531-91373b703b0b tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3" status: 404 len: 109 microversion: 2.1 time: 0.047294 Oct 06 04:34:13.578716 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 214/399] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:34:13 2022] GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:34:13.592725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9a666fe4-3b67-43ca-8bb2-8e59187ec397 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42c5d430>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:13.623267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-9a666fe4-3b67-43ca-8bb2-8e59187ec397 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] HTTP exception thrown: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9a666fe4-3b67-43ca-8bb2-8e59187ec397 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Request method failure captured: Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: DELETE /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 HTTP/1.1 Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlq7kh3b1zujysi9FngaC1w5y4jHqxZQ5Roa_vh5Sdyc0jp5r5wO9Mg8B8noYmMYHyhrZ0jZcghYQuiohw2XInsEOc0kmst6V7Vy29mAhT8qqB5cFPHq6x12JmBPwobHYI1Wl9rQ8bui3Aq0qFGaHX7psXzwyBUKQycVRWRicm8Fhmg Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: e0af60ab182841269cee39048e22984d Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:34:13.625362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0af60ab182841269cee39048e22984d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0af60ab182841269cee39048e22984d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0af60ab182841269cee39048e22984d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0af60ab182841269cee39048e22984d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: e0af60ab182841269cee39048e22984d Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesSnapshotsTestJSON-1481671830-project Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: b4d39c850b024bde8e69665a85f09d8a Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481671830-project Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'f570da63-926c-4109-8114-65444c96aed3'} Oct 06 04:34:13.626795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. (HTTP 404) (Request-ID: req-eaa46f83-10ca-49bd-b1e2-79473b994916) Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.630695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 04:34:13.632589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 04:34:13.633840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9a666fe4-3b67-43ca-8bb2-8e59187ec397 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Returning 404 to user: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:34:13.635160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9a666fe4-3b67-43ca-8bb2-8e59187ec397 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3" status: 404 len: 109 microversion: 2.1 time: 0.037848 Oct 06 04:34:13.636029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:13.636131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 215/400] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:34:13 2022] DELETE /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:34:13.636213 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-511dd499-d61b-43fb-9048-4c051d2cc807 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Calling method '.version_select at 0x7f0c42bed820>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:13.639332 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8f3aa667-976d-4db2-85b7-464ab06387f9 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1318 microversion: 2.1 time: 0.161619 Oct 06 04:34:13.639934 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 186/401] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:13 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:13.664656 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-511dd499-d61b-43fb-9048-4c051d2cc807 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] HTTP exception thrown: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-511dd499-d61b-43fb-9048-4c051d2cc807 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Request method failure captured: Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 HTTP/1.1 Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlq7kh3b1zujysi9FngaC1w5y4jHqxZQ5Roa_vh5Sdyc0jp5r5wO9Mg8B8noYmMYHyhrZ0jZcghYQuiohw2XInsEOc0kmst6V7Vy29mAhT8qqB5cFPHq6x12JmBPwobHYI1Wl9rQ8bui3Aq0qFGaHX7psXzwyBUKQycVRWRicm8Fhmg Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: e0af60ab182841269cee39048e22984d Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:34:13.666633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0af60ab182841269cee39048e22984d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0af60ab182841269cee39048e22984d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0af60ab182841269cee39048e22984d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0af60ab182841269cee39048e22984d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: e0af60ab182841269cee39048e22984d Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481671830 Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesSnapshotsTestJSON-1481671830-project Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: b4d39c850b024bde8e69665a85f09d8a Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481671830-project Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'f570da63-926c-4109-8114-65444c96aed3'} Oct 06 04:34:13.668081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. (HTTP 404) (Request-ID: req-a975b7d4-b11b-40d7-9a1a-6a804bd77f59) Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.668942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 04:34:13.670051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 04:34:13.671372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-511dd499-d61b-43fb-9048-4c051d2cc807 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] Returning 404 to user: Volume f570da63-926c-4109-8114-65444c96aed3 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-511dd499-d61b-43fb-9048-4c051d2cc807 tempest-VolumesSnapshotsTestJSON-1481671830 tempest-VolumesSnapshotsTestJSON-1481671830-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3" status: 404 len: 109 microversion: 2.1 time: 0.035848 Oct 06 04:34:13.672598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 216/402] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:34:13 2022] GET /compute/v2.1/os-volumes/f570da63-926c-4109-8114-65444c96aed3 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:34:13.725759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:13.726364 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:13.732239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:13.732648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:13.733074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:13.733761 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:13.734209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:13.734624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:13.874686 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:13.883143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-38f92fc7-0ea5-48c4-8909-2f13394ad645 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.161680 Oct 06 04:34:13.883801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 187/403] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:13 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:13.932142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:13.933375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: 421a8088-6baa-460d-b451-cb09dfa7bd36] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:13.939399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:13.939886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:13.940328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:13.941026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:13.941632 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:13.942093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:13.955574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] HTTP exception thrown: Instance 421a8088-6baa-460d-b451-cb09dfa7bd36 could not be found. Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Request method failure captured: Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 HTTP/1.1 Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlqqk_cHkdWbSlIFtwkMgT6mTZY-zTQPhFbYWurRdebuHSvuPZ2H-PUbgeXkSNy0jF0btwHjyeoBbF3Taeim7e4P7B5bXto9S-SmmuLnIs-jEyFvYu0IfyhpGA7gJ4Mf26-qU1Z9CIuyqdFMt0a8iUjN_XgC5MqqnJtHfruRNDhthbo Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 250b86943e2d45dc992421c2adee42b2 Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesActionsTest-1235339207 Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:34:13.957096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/250b86943e2d45dc992421c2adee42b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/250b86943e2d45dc992421c2adee42b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_250b86943e2d45dc992421c2adee42b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/250b86943e2d45dc992421c2adee42b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesActionsTest-1235339207 Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 250b86943e2d45dc992421c2adee42b2 Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesActionsTest-1235339207 Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesActionsTest-1235339207-project Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: db187750f7514609923133b9a5f17ae7 Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesActionsTest-1235339207-project Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 421a8088-6baa-460d-b451-cb09dfa7bd36 could not be found. Oct 06 04:34:13.958582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '421a8088-6baa-460d-b451-cb09dfa7bd36'} Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421a8088-6baa-460d-b451-cb09dfa7bd36 could not be found. Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:34:13.960009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421a8088-6baa-460d-b451-cb09dfa7bd36 could not be found. Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421a8088-6baa-460d-b451-cb09dfa7bd36 could not be found. Oct 06 04:34:13.961239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:34:13.962422 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Returning 404 to user: Instance 421a8088-6baa-460d-b451-cb09dfa7bd36 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:34:13.962422 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bb365f9e-b1e6-4cac-ac24-bea00db9582c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36" status: 404 len: 111 microversion: 2.1 time: 0.030983 Oct 06 04:34:13.962422 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 217/404] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:13 2022] GET /compute/v2.1/servers/421a8088-6baa-460d-b451-cb09dfa7bd36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:34:14.066531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1957931031", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "networks": [{"uuid": "1983fdd1-b263-4e74-8c0a-f8ec327f5bd3"}]}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:14.127749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] validate_networks() for [('1983fdd1-b263-4e74-8c0a-f8ec327f5bd3', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:34:14.495699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:34:14.496278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:34:14.496603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:34:14.497008 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:34:14.497407 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:34:14.508752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:14.509306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:14.509745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:14.510479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:14.511064 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:14.511498 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:14.528973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Getting quotas for project 250b86943e2d45dc992421c2adee42b2. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:34:14.532942 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Getting quotas for user db187750f7514609923133b9a5f17ae7 and project 250b86943e2d45dc992421c2adee42b2. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:34:14.544369 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:34:14.546763 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:34:14.596780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-68e6a8dc-1d52-46d8-8b37-cafcbc499b9e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534164 Oct 06 04:34:14.597347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 188/405] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:34:14.609326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-848120f6-57e5-416b-9c96-90f31fe5322c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:14.610710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-848120f6-57e5-416b-9c96-90f31fe5322c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:14.612648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:14.613720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=6 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:14.662096 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:14.663144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:14.671215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:14.671960 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:14.672551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:14.673405 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:14.674182 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:14.675116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:14.681887 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-848120f6-57e5-416b-9c96-90f31fe5322c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:14.689159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-848120f6-57e5-416b-9c96-90f31fe5322c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1214 microversion: 2.1 time: 0.084365 Oct 06 04:34:14.691035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 218/406] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:14 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:14.821192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:14.830369 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-95cf2922-a54b-4346-8966-dc7401d2b6c4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1318 microversion: 2.1 time: 0.172626 Oct 06 04:34:14.831156 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 189/407] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:14 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:14.907463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:14.908385 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:14.915809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:14.916344 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:14.916809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:14.917806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:14.918585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:14.919040 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:15.083621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:15.091931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cd44b575-66e2-4322-9607-e3783f63631c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.188274 Oct 06 04:34:15.092595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 219/408] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:14 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:15.715132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:15.716375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:15.722825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:15.723385 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:15.724019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:15.724873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:15.725911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:15.726487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:15.801884 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:15.811556 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-91d8955c-466b-4d5b-a9ba-3642a14368e2 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1218 microversion: 2.1 time: 0.101975 Oct 06 04:34:15.819308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 190/409] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:15 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:15.856634 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:15.857532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:15.863617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:15.864087 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:15.864646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:15.865523 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:15.866903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:15.867688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:16.015657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:16.029222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-72ba50fc-a52e-4449-96ff-eaf28618ab24 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1318 microversion: 2.1 time: 0.177353 Oct 06 04:34:16.029914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 220/410] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:15 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:16.114392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:16.115145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:16.122495 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:16.122854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:16.123325 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:16.124026 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:16.124479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:16.124900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:16.268674 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:16.279033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1bd8389b-19f1-46e4-98ae-532658caee3a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.168124 Oct 06 04:34:16.279933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 191/411] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:16 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:16.835145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:16.836058 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:16.845497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:16.846265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:16.847334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:16.848310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:16.848991 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:16.849565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:16.921273 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:16.947444 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-34a04b02-1a09-4084-9380-c66c7fe422c0 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1266 microversion: 2.1 time: 0.117560 Oct 06 04:34:16.948033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 221/412] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:16 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:17.055663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:17.056890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:17.063469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:17.064143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:17.064571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:17.065419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:17.066131 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:17.066551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:17.302240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:17.303108 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:17.309698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:17.310414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:17.311193 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:17.312416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:17.312984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:17.313516 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:17.476476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:17.485035 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-944797d2-306f-420b-aea6-41e5057ae0cc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1318 microversion: 2.1 time: 0.435633 Oct 06 04:34:17.485870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 192/413] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:17 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:17.800737 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-65310213-b22d-42f2-828c-95da8c436d11 req-4271a8a6-518b-49e2-8fd2-4eee1e22bc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304e35c3-5e47-4f8b-abf1-ac65e8ebe723", "name": "network-vif-plugged", "status": "completed", "tag": "0b629cb4-849e-443b-9802-793f64a0c62e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:17.813852 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-65310213-b22d-42f2-828c-95da8c436d11 req-4271a8a6-518b-49e2-8fd2-4eee1e22bc18 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:17.814619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-65310213-b22d-42f2-828c-95da8c436d11 req-4271a8a6-518b-49e2-8fd2-4eee1e22bc18 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:17.815321 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-65310213-b22d-42f2-828c-95da8c436d11 req-4271a8a6-518b-49e2-8fd2-4eee1e22bc18 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:17.827539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-65310213-b22d-42f2-828c-95da8c436d11 req-4271a8a6-518b-49e2-8fd2-4eee1e22bc18 service nova] Creating event network-vif-plugged:0b629cb4-849e-443b-9802-793f64a0c62e for instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 on hv-cinder-86022 Oct 06 04:34:17.832954 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-65310213-b22d-42f2-828c-95da8c436d11 req-4271a8a6-518b-49e2-8fd2-4eee1e22bc18 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036336 Oct 06 04:34:17.833663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 193/414] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:34:17.881759 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:17.889676 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b5401571-d058-4b9c-b9dc-35a6eb034a41 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.591813 Oct 06 04:34:17.890249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 222/415] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:17 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:17.970294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:17.971386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:17.981959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:17.982772 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:17.983446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:17.984365 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:17.985182 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:17.985815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:18.065534 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:18.082059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1490db2b-bea2-42d0-bef8-52df4d67b4c5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1272 microversion: 2.1 time: 0.116046 Oct 06 04:34:18.082642 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 194/416] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:17 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:18.508975 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:18.509588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:18.516491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:18.517177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:18.517603 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:18.518309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:18.518761 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:18.519512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:18.754785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:18.764351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a1bbf3b4-f15c-4825-b734-4fc81c32a8ed tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1318 microversion: 2.1 time: 0.259805 Oct 06 04:34:18.780697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 223/417] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:18 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:18.913015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:18.913928 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:18.920552 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:18.921044 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:18.921487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:18.922190 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:18.922652 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:18.923117 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:19.060048 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:19.068480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-aa88eb48-3306-4303-9918-1f55def6c144 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.160044 Oct 06 04:34:19.069103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 195/418] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:18 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:19.105157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:19.105857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:19.111836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:19.112406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:19.112907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:19.113668 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:19.114194 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:19.114690 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:19.262732 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:19.270932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8cbbddb4-c244-41c5-9a95-ae5036e77003 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.169603 Oct 06 04:34:19.271521 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 224/419] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:19 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:19.787616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:19.788184 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:19.795491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:19.796259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:19.796902 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:19.797782 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:19.798650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:19.799334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:19.947231 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:19.965081 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-591513c9-2108-4ce7-b2f2-0d85540b3af7 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1318 microversion: 2.1 time: 0.181261 Oct 06 04:34:19.968797 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 196/420] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:19 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:20.091981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:20.093250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:20.101105 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:20.102007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:20.102699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:20.103840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:20.104562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:20.105255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:20.294113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:20.295329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:20.302914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:20.303375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:20.303926 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:20.304619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:20.305246 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:20.305675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:20.312905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:20.324831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-12f9f942-ac6d-4387-b66a-6850d4efc3a7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.236722 Oct 06 04:34:20.326335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 225/421] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:20 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:20.350240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-4aafddf6-cafd-4212-941e-577ad351df68 req-bd4c7ea9-2c2e-4fc4-b8c3-650c8e51b964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb260154-0e77-4cad-9e05-fcbcc71b87ec", "tag": "4c9cd285-136a-40c0-8315-78bdc1f66c6e"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:20.360900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-4aafddf6-cafd-4212-941e-577ad351df68 req-bd4c7ea9-2c2e-4fc4-b8c3-650c8e51b964 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:20.361585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-4aafddf6-cafd-4212-941e-577ad351df68 req-bd4c7ea9-2c2e-4fc4-b8c3-650c8e51b964 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:20.362181 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-4aafddf6-cafd-4212-941e-577ad351df68 req-bd4c7ea9-2c2e-4fc4-b8c3-650c8e51b964 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:20.375238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-4aafddf6-cafd-4212-941e-577ad351df68 req-bd4c7ea9-2c2e-4fc4-b8c3-650c8e51b964 service nova] Creating event network-changed:4c9cd285-136a-40c0-8315-78bdc1f66c6e for instance eb260154-0e77-4cad-9e05-fcbcc71b87ec on hv-cinder-86022 Oct 06 04:34:20.380625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-4aafddf6-cafd-4212-941e-577ad351df68 req-bd4c7ea9-2c2e-4fc4-b8c3-650c8e51b964 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034209 Oct 06 04:34:20.382202 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 226/422] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:20.449282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:20.457367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-303b9a5c-ac48-4754-ab37-4596720c5853 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.167564 Oct 06 04:34:20.457933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 197/423] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:20 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:20.994136 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:20.995282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:21.002152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:21.002929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:21.003383 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:21.004318 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:21.005866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:21.006583 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:21.228612 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:21.236708 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-795bd006-542e-4e9f-833b-1b7ad1ed5c3b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1506 microversion: 2.1 time: 0.247964 Oct 06 04:34:21.237260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 227/424] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:20 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:21.360499 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:21.361103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:21.368483 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:21.368980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:21.369421 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:21.370130 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:21.370631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:21.375086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:21.486010 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:21.487051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:21.495804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:21.497502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:21.498161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:21.499348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:21.520520 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:21.524903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:21.539955 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:21.549498 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f9c74052-d18e-4e18-84f6-e3960fdafa1c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.199963 Oct 06 04:34:21.550110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 198/425] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:21 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:21.816585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:21.826979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-784146e2-3fdd-4828-8a93-98ed1db19be7 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.349364 Oct 06 04:34:21.827589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 228/426] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:21 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:22.574132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:22.574586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:22.581161 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:22.581711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:22.582209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:22.582900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:22.583379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:22.583889 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:22.783414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:22.792171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e6fb7a76-8c6a-4b05-a4d3-31c1103484d5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.221815 Oct 06 04:34:22.792882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 199/427] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:22 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:22.852342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:22.852953 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:22.859756 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:22.860248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:22.860694 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:22.861406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:22.861865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:22.862295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:23.058122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:23.067580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-026ab0db-a48c-490d-abc2-6bed2daf2e0f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.219499 Oct 06 04:34:23.072556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 229/428] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:22 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:23.819233 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:23.820600 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:23.827259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:23.827741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:23.828203 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:23.828905 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:23.829355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:23.829769 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:23.833843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:23.980936 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:23.989371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-715f2fe0-ee8b-49a3-a9a7-aacee74bb048 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.174641 Oct 06 04:34:23.989934 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 200/429] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:23 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:24.098472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:24.099144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:24.105776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:24.106316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:24.106831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:24.107626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:24.108335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:24.109003 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:24.244968 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:24.253449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-780a9877-0eb3-4662-b763-82ee4fce2960 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.158814 Oct 06 04:34:24.254230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 230/430] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:24 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:25.012998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:25.013745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:25.015670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:25.016471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=8 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:25.024489 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:25.025072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:25.025582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:25.026399 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:25.026976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:25.027418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:25.174567 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:25.183596 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-153375c6-cc94-439d-a193-01e94e2f1ca9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.174264 Oct 06 04:34:25.184037 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 201/431] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:25 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:25.278126 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:25.278749 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:25.280796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:25.286494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:25.287088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:25.288153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:25.288875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:25.289334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:25.289765 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:25.463317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:25.472640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7f23695e-f781-48b4-91c5-44c6947da2db tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.198028 Oct 06 04:34:25.472928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 231/432] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:25 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:26.207268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:26.207867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:26.214390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:26.214873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:26.215329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:26.216094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:26.216543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:26.216965 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:26.376110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:26.384491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ca4f926d-77cf-4b2d-b400-83fa87180b45 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.181114 Oct 06 04:34:26.385045 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 202/433] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:26 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:26.496794 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:26.498130 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:26.504615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:26.505289 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:26.505789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:26.506860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:26.507491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:26.508206 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:26.531240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:26.660440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:26.669147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b8a43db8-6972-49f7-9d3a-9ec4efda0696 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.176624 Oct 06 04:34:26.669729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 232/434] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:26 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:27.407475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:27.408090 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:27.414943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:27.415674 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:27.416284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:27.417147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:27.417758 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:27.418339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:27.557069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:27.565086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ff820433-5feb-4241-bd3d-3d8bb996fa96 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.161460 Oct 06 04:34:27.565661 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 203/435] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:27 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:27.691786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:27.693096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:27.700512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:27.701017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:27.701460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:27.702182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:27.702641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:27.703101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:27.848212 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:27.857648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-40b959ee-ddcd-4946-b574-2a38f35aac6c tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.169685 Oct 06 04:34:27.858400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 233/436] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:27 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:27.982970 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-aa8b4274-2a74-48f7-afbd-c91937f16799 req-051cd35c-820c-4bf7-9a65-6f9ba366c413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb260154-0e77-4cad-9e05-fcbcc71b87ec", "name": "network-vif-plugged", "status": "completed", "tag": "4c9cd285-136a-40c0-8315-78bdc1f66c6e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:27.994323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-aa8b4274-2a74-48f7-afbd-c91937f16799 req-051cd35c-820c-4bf7-9a65-6f9ba366c413 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:27.994948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-aa8b4274-2a74-48f7-afbd-c91937f16799 req-051cd35c-820c-4bf7-9a65-6f9ba366c413 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:27.995875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-aa8b4274-2a74-48f7-afbd-c91937f16799 req-051cd35c-820c-4bf7-9a65-6f9ba366c413 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:28.010573 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-aa8b4274-2a74-48f7-afbd-c91937f16799 req-051cd35c-820c-4bf7-9a65-6f9ba366c413 service nova] Creating event network-vif-plugged:4c9cd285-136a-40c0-8315-78bdc1f66c6e for instance eb260154-0e77-4cad-9e05-fcbcc71b87ec on hv-cinder-86022 Oct 06 04:34:28.015965 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-aa8b4274-2a74-48f7-afbd-c91937f16799 req-051cd35c-820c-4bf7-9a65-6f9ba366c413 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036991 Oct 06 04:34:28.016858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 204/437] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:28.588679 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:28.589287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:28.595187 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:28.595666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:28.596097 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:28.596779 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:28.597225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:28.597645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:28.725914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:28.733462 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7e397cd2-23a1-4bb5-9c3f-ccdf400fc714 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.148653 Oct 06 04:34:28.734018 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 234/438] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:28 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:28.882654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:28.883318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:28.889485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:28.889960 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:28.890387 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:28.891100 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:28.891549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:28.891968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:29.052240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:29.061585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-52d5e74d-58bd-442f-b813-6a9e06d5645e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.183648 Oct 06 04:34:29.062155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 205/439] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:28 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:29.757194 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:29.757773 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:29.763930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:29.764410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:29.764838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:29.765521 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:29.765972 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:29.766389 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:29.895006 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:29.903062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f68acb76-1129-4bd2-8ad6-06fb6528eb8d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.149723 Oct 06 04:34:29.903618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 235/440] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:29 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:30.084904 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:30.085515 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:30.091586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:30.092072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:30.092504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:30.093198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:30.093651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:30.094080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:30.253715 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:30.266265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c52b0713-800f-41ca-bbd0-d0418b860235 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.185623 Oct 06 04:34:30.268071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 206/441] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:30 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:30.928844 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:30.929483 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:30.935333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:30.935815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:30.936245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:30.937025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:30.937480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:30.937970 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:31.079549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:31.087347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0646974a-175d-457c-ba92-abac136cf302 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.162845 Oct 06 04:34:31.087912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 236/442] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:30 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:31.292119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:31.292736 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:31.304562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:31.305052 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:31.305492 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:31.306202 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:31.306655 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:31.307162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:31.441361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:31.450448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fab629cb-ae93-45b4-81f0-7f4761425963 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.163699 Oct 06 04:34:31.451055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 207/443] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:31 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:32.110221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:32.110824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:32.117435 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:32.118161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:32.118603 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:32.119326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:32.119775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:32.120198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:32.248342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:32.255938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8f807247-8acf-4987-b22a-d76308056098 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.149498 Oct 06 04:34:32.256649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 237/444] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:32 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:32.473242 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:32.473780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:32.480605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:32.481081 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:32.481513 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:32.482194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:32.482643 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:32.483085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:32.608976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:32.617129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8e2a85ac-1636-4304-8cdb-3308386f15ce tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.147722 Oct 06 04:34:32.617685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 208/445] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:32 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:33.279458 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:33.280071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:33.285962 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:33.286447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:33.286945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:33.287660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:33.288134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:33.288557 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:33.430683 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:33.438351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5a64ce25-81eb-424c-bd27-235f88cb4789 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.162739 Oct 06 04:34:33.438919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 238/446] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:33 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:33.639619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:33.640225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:33.646503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:33.647000 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:33.647430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:33.648111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:33.648559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:33.648976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:33.779084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:33.786601 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-70728435-07c3-4f2b-93fe-d68dad707d5e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.150863 Oct 06 04:34:33.787911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 209/447] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:33 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:34.462418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:34.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:34.468981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:34.469428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:34.469865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:34.470553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:34.471026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:34.471453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:34.598907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:34.606723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6a9b3dcb-1926-45c4-b0a9-84f40699452b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.148855 Oct 06 04:34:34.607321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 239/448] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:34 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:34:34.809530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:34.810064 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:34.816359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:34.816838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:34.817368 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:34.818566 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:34.819041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:34.819466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:34.948670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:34.956202 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2b5733d1-d031-4270-b2c1-87d3883460d5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.150597 Oct 06 04:34:34.956760 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 210/449] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:34 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:35.629430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:35.630039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:35.636091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:35.636574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:35.637009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:35.637703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:35.638158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:35.638581 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:35.763716 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:35.772327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fa49b611-ddd0-4433-b96d-e42ba615b651 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.146688 Oct 06 04:34:35.772894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 240/450] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:35 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:35.982412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:35.983003 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:35.989585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:35.990349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:35.990809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:35.991528 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:35.992000 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:35.992403 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:36.120483 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:36.128001 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-323e0edb-67c2-4854-ab31-2143dbe5731d tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.153441 Oct 06 04:34:36.128589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 211/451] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:35 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:36.795648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:36.796254 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:36.802163 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:36.803315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:36.803752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:36.804444 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:36.804902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:36.805328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:36.934662 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:36.942639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8ccd44a0-a339-4a92-9278-83e1f1171415 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.150802 Oct 06 04:34:36.943283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 241/452] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:36 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:37.151498 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:37.152026 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:37.158404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:37.158880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:37.159355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:37.160040 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:37.160486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:37.160907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:37.292309 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:37.299857 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0a4128d0-3b4a-4981-89e8-9045c11a405f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.153058 Oct 06 04:34:37.300418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 212/453] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:37 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:37.965688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:37.966288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:37.973294 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:37.973718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:37.974777 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:37.975582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:37.976037 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:37.976461 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:38.107782 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:38.115353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6e47ad73-c164-4af0-a2af-604a0db9723e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1521 microversion: 2.1 time: 0.153526 Oct 06 04:34:38.115912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 242/454] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:37 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:38.323197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:38.323818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:38.325748 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:38.330665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:38.331191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:38.331627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:38.332316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:38.332778 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:38.333196 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:38.476461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:38.484998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7393dd6d-09e4-4deb-842c-b49fcf5b941f tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1314 microversion: 2.1 time: 0.166839 Oct 06 04:34:38.485866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 213/455] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:38 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:39.137788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:39.138396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:39.144654 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:39.145246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:39.145687 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:39.147034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:39.147496 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:39.147939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:39.283591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:39.291509 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7f19ba6c-a9a7-41f0-ac51-43637abeeca0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1501 microversion: 2.1 time: 0.157569 Oct 06 04:34:39.292081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 243/456] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:39 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:39.314500 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:39.315111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:39.322055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:39.322532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:39.322978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:39.323691 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:39.324224 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:39.324527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:39.461316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:39.469075 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5f7ae365-b3e5-459d-9146-8f7c65fb0ac0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1517 microversion: 2.1 time: 0.158533 Oct 06 04:34:39.469632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 214/457] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:39 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:39.508558 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:39.509229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:39.515085 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:39.515567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:39.516074 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:39.517587 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:39.518045 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:39.518471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:39.654836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:39.664314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-29c3832a-71a2-4e57-b065-26c91f106064 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1499 microversion: 2.1 time: 0.160206 Oct 06 04:34:39.664883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 244/458] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:39 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1499 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:40.892761 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:40.895108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:40.902231 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:40.902713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:40.903258 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:40.903975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:40.904427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:40.904847 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:40.926866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lazy-loading 'flavor' on Instance uuid 7b1de82b-ccd4-4783-8f2b-8db183ab18ae {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:34:41.018433 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:41.042506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-45c01fec-2450-4e42-bd86-504947e618f0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae/action" status: 200 len: 32 microversion: 2.1 time: 0.153714 Oct 06 04:34:41.043123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 215/459] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:34:40 2022] POST /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:34:41.054025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:41.054561 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:41.060612 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:41.061092 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:41.061524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:41.062442 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:41.063260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:41.063726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:41.230428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:41.235614 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:41.236323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:41.238993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-98b91c60-1bd2-4b20-9da9-d14c560d8cfa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.190074 Oct 06 04:34:41.240889 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 245/460] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:41 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:41.257351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:41.257849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:41.258281 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:41.259213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:41.259669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:41.260086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:41.308099 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:34:41.400319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-027668b8-4fbb-47d3-a34e-174f19d93526 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 204 len: 0 microversion: 2.1 time: 0.168873 Oct 06 04:34:41.401130 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 216/461] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:34:41 2022] DELETE /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:34:41.410547 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:41.411354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:41.418854 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:41.419672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:41.420103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:41.420966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:41.421417 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:41.421835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:41.558663 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:41.566611 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5f75d486-b832-4de3-9700-e714aa56ab60 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1505 microversion: 2.1 time: 0.160692 Oct 06 04:34:41.567348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 246/462] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:41 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:42.265129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:42.266454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:42.273197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:42.273678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:42.274113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:42.274885 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:42.275629 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:42.276473 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:42.414627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:42.422535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-543d0d91-9e39-442b-a79e-c65dd67c2f62 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.161734 Oct 06 04:34:42.423134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 217/463] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:42 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:42.590046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:42.590662 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:42.596929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:42.597414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:42.597849 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:42.598541 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:42.599120 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:42.600046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:42.981350 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:42.992714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7d0706f3-dc2f-492b-8354-2a7cdf20d3dc tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1505 microversion: 2.1 time: 0.406128 Oct 06 04:34:42.994272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 247/464] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:42 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:43.446215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:43.446811 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:43.453203 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:43.453777 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:43.454217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:43.454908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:43.455560 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:43.455975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:43.593689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:43.602004 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d74b67b6-b29e-4e05-b7e2-cf6e0575ca16 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.160176 Oct 06 04:34:43.602501 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 218/465] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:43 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:44.016382 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:44.018266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:44.020451 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=65 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:44.027724 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:44.028216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:44.028651 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:44.029360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:44.029809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:44.030422 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:44.177252 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:44.181015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:34:44.187057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-84f8a184-6f45-4575-b77f-a42b6d6c82b5 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1505 microversion: 2.1 time: 0.174491 Oct 06 04:34:44.188436 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 248/466] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:44 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:44.472106 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-0f221c1b-5af0-4ebf-9ded-eedb5bd96f8a req-0ff63b6d-1536-4306-83bf-8c6d7548ad59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb260154-0e77-4cad-9e05-fcbcc71b87ec", "name": "network-vif-deleted", "tag": "4c9cd285-136a-40c0-8315-78bdc1f66c6e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:44.488573 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0f221c1b-5af0-4ebf-9ded-eedb5bd96f8a req-0ff63b6d-1536-4306-83bf-8c6d7548ad59 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:44.489430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0f221c1b-5af0-4ebf-9ded-eedb5bd96f8a req-0ff63b6d-1536-4306-83bf-8c6d7548ad59 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:44.490223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0f221c1b-5af0-4ebf-9ded-eedb5bd96f8a req-0ff63b6d-1536-4306-83bf-8c6d7548ad59 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:44.504308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-0f221c1b-5af0-4ebf-9ded-eedb5bd96f8a req-0ff63b6d-1536-4306-83bf-8c6d7548ad59 service nova] Creating event network-vif-deleted:4c9cd285-136a-40c0-8315-78bdc1f66c6e for instance eb260154-0e77-4cad-9e05-fcbcc71b87ec on hv-cinder-86022 Oct 06 04:34:44.511561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-0f221c1b-5af0-4ebf-9ded-eedb5bd96f8a req-0ff63b6d-1536-4306-83bf-8c6d7548ad59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042999 Oct 06 04:34:44.515351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 219/467] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:44.627228 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:44.627744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:44.635349 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:44.635837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:44.636275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:44.636975 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:44.637433 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:44.637862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:44.767737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:44.776360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c1c29d4f-1888-43f1-8d14-3b6df9ce5310 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.153084 Oct 06 04:34:44.777091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 249/468] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:44 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:45.212942 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:45.213712 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:45.219831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:45.220410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:45.220728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:45.221424 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:45.221872 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:45.222288 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:45.257426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:45.257896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:45.258323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:45.258756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lazy-loading 'fault' on Instance uuid eb260154-0e77-4cad-9e05-fcbcc71b87ec {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:34:45.305142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db187750f7514609923133b9a5f17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250b86943e2d45dc992421c2adee42b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:45.313456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fd250941-5b47-48dc-8e38-d41b51cb9c0e tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 200 len: 1304 microversion: 2.1 time: 0.107332 Oct 06 04:34:45.314018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 220/469] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:45 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:45.800693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:45.801299 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:45.807598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:45.808083 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:45.808518 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:45.809210 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:45.809665 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:45.810092 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:45.937774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:45.945918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fc540f05-7f8c-4d35-ab1b-15ef3306a526 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.149071 Oct 06 04:34:45.946482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 250/470] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:45 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:46.336105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:46.336708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] [instance: eb260154-0e77-4cad-9e05-fcbcc71b87ec] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:46.343077 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:46.343556 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:46.343986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:46.344666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:46.345113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:46.345530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:46.358656 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] HTTP exception thrown: Instance eb260154-0e77-4cad-9e05-fcbcc71b87ec could not be found. Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Request method failure captured: Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec HTTP/1.1 Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlqqk_cHkdWbSlIFtwkMgT6mTZY-zTQPhFbYWurRdebuHSvuPZ2H-PUbgeXkSNy0jF0btwHjyeoBbF3Taeim7e4P7B5bXto9S-SmmuLnIs-jEyFvYu0IfyhpGA7gJ4Mf26-qU1Z9CIuyqdFMt0a8iUjN_XgC5MqqnJtHfruRNDhthbo Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 250b86943e2d45dc992421c2adee42b2 Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-VolumesActionsTest-1235339207 Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:34:46.360285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/250b86943e2d45dc992421c2adee42b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/250b86943e2d45dc992421c2adee42b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_250b86943e2d45dc992421c2adee42b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/250b86943e2d45dc992421c2adee42b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-VolumesActionsTest-1235339207 Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 250b86943e2d45dc992421c2adee42b2 Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-VolumesActionsTest-1235339207 Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-VolumesActionsTest-1235339207-project Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: db187750f7514609923133b9a5f17ae7 Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-VolumesActionsTest-1235339207-project Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance eb260154-0e77-4cad-9e05-fcbcc71b87ec could not be found. Oct 06 04:34:46.361790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': 'eb260154-0e77-4cad-9e05-fcbcc71b87ec'} Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb260154-0e77-4cad-9e05-fcbcc71b87ec could not be found. Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:34:46.362599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb260154-0e77-4cad-9e05-fcbcc71b87ec could not be found. Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb260154-0e77-4cad-9e05-fcbcc71b87ec could not be found. Oct 06 04:34:46.364094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:34:46.365875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] Returning 404 to user: Instance eb260154-0e77-4cad-9e05-fcbcc71b87ec could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:34:46.365875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5c09759e-1bd3-4e8e-8e35-72e25542bd61 tempest-VolumesActionsTest-1235339207 tempest-VolumesActionsTest-1235339207-project] 10.222.0.33 "GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec" status: 404 len: 111 microversion: 2.1 time: 0.029548 Oct 06 04:34:46.365875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 221/471] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:46 2022] GET /compute/v2.1/servers/eb260154-0e77-4cad-9e05-fcbcc71b87ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:34:46.969602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:46.970387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:46.976720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:46.977222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:46.977660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:46.978405 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:46.979002 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:46.979464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:47.125360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:47.135159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-32930fc1-3ade-4e23-835e-f61c3412eea6 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.168624 Oct 06 04:34:47.135159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 251/472] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:46 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:48.157553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:48.158673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:48.166032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:48.166520 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:48.166976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:48.167669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:48.168115 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:48.168738 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:48.307256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:48.314845 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a6c0e7c0-8c3c-4ae1-8eea-3ad8bc022087 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.161115 Oct 06 04:34:48.315442 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 222/473] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:48 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:49.339335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:49.339941 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:49.345848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:49.346326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:49.346756 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:49.347464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:49.347916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:49.348336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:49.479822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:49.487404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6f4a0de6-4627-4048-b371-df70315b9716 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.151848 Oct 06 04:34:49.487961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 252/474] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:49 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:50.509682 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:50.510318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:50.516638 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:50.517116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:50.517543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:50.518217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:50.518668 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:50.519111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:50.648974 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:50.656564 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4af4b81f-e9cf-4193-846c-b6dedeaf26cc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.150876 Oct 06 04:34:50.657121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 223/475] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:50 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:51.679292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:51.679898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:51.685994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:51.686478 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:51.686911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:51.687697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:51.688152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:51.688580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:51.838141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:51.845720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-db9aaa52-fcf4-4a6a-9139-66eb5759ef97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.170294 Oct 06 04:34:51.846280 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 253/476] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:51 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:52.869435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:52.869985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:52.876351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:52.876825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:52.877253 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:52.877935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:52.878382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:52.878800 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:53.007031 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:53.014558 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-64a31fbd-f884-4ee6-925d-5c44cec5236d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.149343 Oct 06 04:34:53.015144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 224/477] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:52 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:54.038856 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:54.040106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:54.046785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:54.047723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:54.048590 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:54.049532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:54.050371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:54.050851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:54.215337 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:54.227465 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ed5088d7-4fc2-4581-aba2-f4b4c0db6000 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.193204 Oct 06 04:34:54.228649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 254/478] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:54 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:54.780254 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a912236-b4a7-4d02-81d2-6ce7f6cde248", "device": "/dev/sdb"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:34:54.783681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:54.791568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:54.792282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:54.792958 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:54.793685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:54.794322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:54.794757 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:55.260870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2dceb52d-4332-4886-9e49-27b3b8fc5cd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "POST /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478557 Oct 06 04:34:55.261134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:55.261134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:55.263848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 225/479] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:34:54 2022] POST /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:34:55.273427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:55.274533 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:55.276870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:55.277601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:55.278176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:55.278673 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:55.470028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:55.481699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e4533c95-378b-4bd6-9cfa-19283e09832c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.227492 Oct 06 04:34:55.482387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 255/480] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:55 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:56.506881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:56.507936 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:56.514563 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:56.515149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:56.515666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:56.516440 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:56.516968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:56.517481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:56.658849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:56.664728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6d438195-cb77-46b1-81c5-7aab8c66d5f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.162168 Oct 06 04:34:56.665214 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 226/481] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:56 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:57.688295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:57.688905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:57.695233 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:57.695946 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:57.696586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:57.697507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:57.698145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:57.698751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:57.844866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:57.853505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-46086c61-110b-470f-8bc7-8d97cbb72e78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.169116 Oct 06 04:34:57.854104 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 256/482] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:57 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:34:58.876612 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:34:58.877968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:34:58.888737 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:58.891080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:58.891795 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:58.892759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:34:58.893438 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:34:58.894126 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:34:59.034072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:34:59.044347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6399c8dc-dadd-4961-818a-51b499169110 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.171237 Oct 06 04:34:59.059313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 227/483] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:34:58 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:00.070910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:00.072247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:00.081625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:00.082651 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:00.083405 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:00.084260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:00.084846 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:00.085459 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:00.256368 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:00.266942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-724df2d0-bd6c-4be6-9519-170c028b481b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.202929 Oct 06 04:35:00.267812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 257/484] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:00 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:01.293486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:01.294385 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:01.302029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:01.302635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:01.303105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:01.303810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:01.304265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:01.304690 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:01.470336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:01.479284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1a8b641f-186a-4603-8803-f47b4c90815e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.189821 Oct 06 04:35:01.487448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 228/485] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:01 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:02.504076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:02.506260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:02.521675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:02.522194 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:02.522645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:02.523398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:02.523864 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:02.524296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:02.674831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:02.683866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-315c3326-443b-443b-8706-9382a8615f78 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.183532 Oct 06 04:35:02.687299 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 258/486] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:02 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:03.707823 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:03.708730 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:03.715597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:03.716320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:03.716768 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:03.717463 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:03.717912 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:03.718336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:03.874711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:03.884968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-50ac557d-9698-4d08-9e8d-1fa31bd9d39b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.181158 Oct 06 04:35:03.899563 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 229/487] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:03 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:04.909408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:04.910134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:04.916540 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:04.917118 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:04.917618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:04.918338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:04.918788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:04.919249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:05.066065 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:05.075185 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-94dba44d-7f2d-42a0-b34a-7f2195bcde1b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.169486 Oct 06 04:35:05.076169 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 259/488] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:04 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:06.102286 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:06.103638 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:06.111424 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:06.112297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:06.112959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:06.114462 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:06.115256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:06.115875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:06.121102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:06.272835 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:06.282745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8c0c9a9f-0112-414c-afb5-4fa3ba75b750 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.185166 Oct 06 04:35:06.283461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 230/489] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:06 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:07.315130 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:07.316688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:07.325695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:07.326351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:07.326872 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:07.327828 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:07.328480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:07.329103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:07.508291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:07.517227 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-629483b0-49ac-4776-bf14-0af79e84df11 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.212067 Oct 06 04:35:07.518390 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 260/490] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:07 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:08.545074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:08.545648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:08.548209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:08.554669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:08.555189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:08.555838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:08.556874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:08.557480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:08.557903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:08.702675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:08.715987 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3bdba41a-a115-4be6-9477-9a424aa6637f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.174628 Oct 06 04:35:08.716782 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 231/491] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:08 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:09.740089 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:09.740649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:09.747068 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:09.747552 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:09.747982 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:09.748674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:09.749122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:09.749545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:09.878322 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:09.886427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-83ac1e9c-25dc-4909-9b10-fd64b6e3cbcc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.150868 Oct 06 04:35:09.887026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 261/492] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:09 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:10.910920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:10.911636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:10.917976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:10.918445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:10.918889 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:10.919667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:10.920120 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:10.920545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:11.048838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:11.057547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-07923461-1c3d-4ee1-88c0-44cca6cf679d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.150557 Oct 06 04:35:11.058106 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 232/493] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:10 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:12.081222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:12.081835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:12.087789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:12.088275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:12.088712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:12.089410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:12.089861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:12.090289 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:12.222737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:12.230992 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f1ecf6a5-602c-4fb8-8e5f-8b71355f6307 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.153615 Oct 06 04:35:12.231557 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 262/494] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:12 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:13.253556 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:13.254763 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:13.261162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:13.261631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:13.262065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:13.262755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:13.263237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:13.263661 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:13.393709 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:13.401378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-67dfcfd6-85e9-40de-bfae-90fca231dc6f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.151676 Oct 06 04:35:13.401982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 233/495] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:13 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:14.424841 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:14.425449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:14.428037 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=30 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:14.433221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:14.433709 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:14.434145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:14.434843 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:14.435325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:14.435765 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:14.572681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:14.580216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a79a73c9-0461-4df8-959a-19583bd9e342 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.159353 Oct 06 04:35:14.581002 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 263/496] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:14 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:15.603128 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:15.603731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:15.610090 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:15.610572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:15.611017 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:15.611716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:15.612163 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:15.612581 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:15.796223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:15.807747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f598ccf7-0fcf-41fb-9a95-8fd7c603301b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.208472 Oct 06 04:35:15.808676 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 234/497] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:15 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:16.831128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:16.831823 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:16.838589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:16.839123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:16.839555 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:16.840248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:16.840697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:16.841116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:16.845636 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=91 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:16.980307 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:16.988106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-35499ebf-0e0c-4262-9ddc-ce988a133bdf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.160699 Oct 06 04:35:16.988677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 264/498] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:16 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:18.011635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:18.012241 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:18.018443 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:18.018914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:18.019371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:18.020821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:18.021278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:18.021696 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:18.149598 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:18.157298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ecf8d178-a432-419e-923e-cc8327d48c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.149472 Oct 06 04:35:18.157854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 235/499] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:18 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:19.181233 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:19.181835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:19.187662 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:19.188144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:19.188576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:19.189298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:19.189747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:19.190169 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:19.325392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:19.333002 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-95bb23a4-1cf8-40c5-a782-73f9f219a04b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.155736 Oct 06 04:35:19.333559 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 265/500] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:19 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:20.356205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:20.356804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:20.364062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:20.364583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:20.365017 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:20.365739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:20.366210 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:20.366631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:20.495904 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:20.503401 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1bfca89a-9919-435e-8fbf-430521d2fc5c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.151311 Oct 06 04:35:20.504459 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 236/501] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:20 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:21.527196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:21.527888 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:21.534655 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:21.535818 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:21.536373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:21.537519 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:21.538239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:21.538818 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:21.672867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:21.680698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-01bb9c5b-19b3-4163-95ad-0926b6880e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.157519 Oct 06 04:35:21.681255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 266/502] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:21 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:22.704557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:22.705753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:22.712516 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:22.713001 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:22.713431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:22.714124 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:22.714569 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:22.715005 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:22.854730 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:22.863142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-affef876-680c-494a-b16e-a8c7417f9fb7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1503 microversion: 2.1 time: 0.162595 Oct 06 04:35:22.864313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 237/503] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:22 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:22.888981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b93b4a8-aed1-4058-b40d-9cd919489537"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:22.890074 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:22.897410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:22.897933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:22.898412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:22.899170 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:22.899619 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:22.900038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:22.923714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] HTTP exception thrown: Cannot 'attach_volume' instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae while it is in vm_state rescued Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Request method failure captured: Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: POST /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae/os-volume_attachments HTTP/1.1 Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 74 Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpdmJ34Bmk4FmKO5HlGen5bIAzhZqAQylenpJ7_85ZNW-tfMBrtX5dNifLzg9qKz4HDOyxWOxuVA4Tc996oHqqYYeK8DZho_hK92ett81rJJ3pmHidzYBDzAXuAqnUY0__1XlKsU871-sBzdrj8JiETRmBx_OUIVSIuhEghLwqhEq0 Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:35:22.925597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: a58cd041c02d46dcb8acf6adb11ee9de Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {"volumeAttachment": {"volumeId": "8b93b4a8-aed1-4058-b40d-9cd919489537"}} Oct 06 04:35:22.926906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Cannot 'attach_volume' instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae while it is in vm_state rescued Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'server_id': '7b1de82b-ccd4-4783-8f2b-8db183ab18ae', 'body': {'volumeAttachment': {'volumeId': '8b93b4a8-aed1-4058-b40d-9cd919489537'}}} Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:35:22.927714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae while it is in vm_state rescued Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:35:22.928873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:35:22.929976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:35:22.929976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:35:22.929976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae while it is in vm_state rescued Oct 06 04:35:22.929976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:22.929976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Returning 409 to user: Cannot 'attach_volume' instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae while it is in vm_state rescued {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:35:22.929976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c190ffc0-e423-4dbc-b6cd-585305339f89 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044149 Oct 06 04:35:22.929976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 267/504] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:35:22 2022] POST /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 04:35:22.936376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:22.936912 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:22.943655 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:22.944138 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:22.944676 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:22.945272 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:22.945929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:22.946727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:23.015503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b43fb08b-8a05-40fb-b293-c6f94e4bde10 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae/action" status: 202 len: 0 microversion: 2.1 time: 0.082741 Oct 06 04:35:23.016123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 238/505] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:35:22 2022] POST /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:35:23.024973 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:23.025588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:23.031566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:23.032054 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:23.032496 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:23.033196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:23.033653 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:23.034086 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:23.197990 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:23.215964 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-44770a5d-2433-4ff8-81c4-395f357214fb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1511 microversion: 2.1 time: 0.194657 Oct 06 04:35:23.217514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 268/506] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:23 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:24.241386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:24.242080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:24.248307 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:24.248794 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:24.249222 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:24.249907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:24.250356 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:24.250778 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:24.391427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:24.399145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d7f32d84-1c17-4d5b-a2c5-400a6589c50d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1511 microversion: 2.1 time: 0.162665 Oct 06 04:35:24.399725 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 239/507] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:24 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:25.422823 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:25.423456 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:25.430524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:25.431027 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:25.431463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:25.432155 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:25.432605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:25.433033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:25.474989 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:25.475543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:25.481531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:25.482018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:25.482454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:25.483178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:25.483639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:25.484061 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:25.566328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:25.574550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-21a94a38-c2fe-4a13-b6f3-1aa7cc8c2180 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1511 microversion: 2.1 time: 0.155577 Oct 06 04:35:25.575248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 269/508] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:25 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:25.614420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lazy-loading 'services' on Instance uuid 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:35:25.733547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-afdaf82d-9a46-43c3-b98a-4ceadb2ce32c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723/os-volume_attachments/3a912236-b4a7-4d02-81d2-6ce7f6cde248" status: 202 len: 0 microversion: 2.1 time: 0.262809 Oct 06 04:35:25.734134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 240/509] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:35:25 2022] DELETE /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723/os-volume_attachments/3a912236-b4a7-4d02-81d2-6ce7f6cde248 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 04:35:26.601751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:26.602618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:26.609035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:26.609624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:26.610128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:26.610924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:26.611411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:26.611922 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:26.745049 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:26.752598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3971b6d7-cfe2-460c-b6a2-973177154c82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1511 microversion: 2.1 time: 0.156321 Oct 06 04:35:26.753151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 270/510] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:26 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:27.777299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:27.778284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:27.785304 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:27.785885 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:27.786392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:27.787484 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:27.787978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:27.788406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:28.083816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:28.093448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a3fdf92d-374f-4211-bf85-874e9d109161 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1517 microversion: 2.1 time: 0.319552 Oct 06 04:35:28.093448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 241/511] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:27 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1517 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:28.984627 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:28.985177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:28.991576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:28.992084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:28.992519 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:28.993810 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:28.994290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:28.994921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:29.020853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:35:29.099366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6ad384b4-ddd0-4932-a3ca-3392d0dd8c32 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 204 len: 0 microversion: 2.1 time: 0.118184 Oct 06 04:35:29.100004 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 271/512] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:35:28 2022] DELETE /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:35:29.108554 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:29.109250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:29.115905 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:29.116422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:29.116834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:29.117534 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:29.117981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:29.118651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:29.254473 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:29.262528 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0b85899b-ce1b-45f3-833d-f47f59aeec93 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1512 microversion: 2.1 time: 0.157907 Oct 06 04:35:29.263160 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 242/513] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:29 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:29.521880 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-663111e3-711e-4d66-b1ca-2bb20973999d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'create', calling method: .version_select at 0x7f0c42bed160>, body: {"keypair": {"name": "tempest-keypair-761951345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrTdJAHP9ZTKawslQQnu33rz6xSrX4f+pDa/3AciJyYjWNVRj1SlQ8+w+pBst6yEOsgAA7mwRVF8G/Q1feHB0Pr6Qi0WczwxcXUcK2N1mzI2jnCGPCgb2IOrJSv/aEOaA=="}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:29.537357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-663111e3-711e-4d66-b1ca-2bb20973999d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Getting quotas for project 0d643fb7b9314f0a9bb8f2c37f06bb2d. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:35:29.541483 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-663111e3-711e-4d66-b1ca-2bb20973999d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Getting quotas for user a58cd041c02d46dcb8acf6adb11ee9de and project 0d643fb7b9314f0a9bb8f2c37f06bb2d. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:35:29.554212 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR oslo.messaging._drivers.impl_rabbit [None req-663111e3-711e-4d66-b1ca-2bb20973999d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [8eedb5d7-9b25-4eba-b20c-aec1510b7481] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 04:35:30.285790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:30.286395 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:30.293530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:30.294004 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:30.294435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:30.295142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:30.295592 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:30.296005 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:30.424469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:30.432615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ca50c56f-2368-4c81-a606-68816907eb0d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1512 microversion: 2.1 time: 0.150817 Oct 06 04:35:30.433179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 243/514] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:30 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:30.561423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO oslo.messaging._drivers.impl_rabbit [None req-663111e3-711e-4d66-b1ca-2bb20973999d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [8eedb5d7-9b25-4eba-b20c-aec1510b7481] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57052. Oct 06 04:35:30.575675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-663111e3-711e-4d66-b1ca-2bb20973999d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.058038 Oct 06 04:35:30.576375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 272/515] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:35:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:35:31.457826 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:31.458198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:31.464939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:31.465737 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:31.466201 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:31.467086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:31.467712 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:31.468142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:31.674706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:31.682604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1bae0d8d-fe09-4935-bb4f-59fd457463c0 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1512 microversion: 2.1 time: 0.229531 Oct 06 04:35:31.683224 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 244/516] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:31 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:35:31.936118 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1648957700", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2378409d-c551-4beb-a9cb-3e077e46deec"}], "security_groups": [{"name": "tempest-securitygroup--1015241692"}], "key_name": "tempest-keypair-761951345", "user_data": "}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:32.044824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] validate_networks() for [('2378409d-c551-4beb-a9cb-3e077e46deec', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:35:32.096148 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-1dd97d21-fe19-424e-8ac2-b4bfedbeeafd req-54d1c667-1468-4937-8e6e-fceb5ac24a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304e35c3-5e47-4f8b-abf1-ac65e8ebe723", "name": "network-vif-deleted", "tag": "0b629cb4-849e-443b-9802-793f64a0c62e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:32.106597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1dd97d21-fe19-424e-8ac2-b4bfedbeeafd req-54d1c667-1468-4937-8e6e-fceb5ac24a02 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:32.107233 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1dd97d21-fe19-424e-8ac2-b4bfedbeeafd req-54d1c667-1468-4937-8e6e-fceb5ac24a02 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:32.107744 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1dd97d21-fe19-424e-8ac2-b4bfedbeeafd req-54d1c667-1468-4937-8e6e-fceb5ac24a02 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:32.115906 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:32.127143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-1dd97d21-fe19-424e-8ac2-b4bfedbeeafd req-54d1c667-1468-4937-8e6e-fceb5ac24a02 service nova] Creating event network-vif-deleted:0b629cb4-849e-443b-9802-793f64a0c62e for instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 on hv-cinder-86022 Oct 06 04:35:32.133074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-1dd97d21-fe19-424e-8ac2-b4bfedbeeafd req-54d1c667-1468-4937-8e6e-fceb5ac24a02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040118 Oct 06 04:35:32.134014 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 245/517] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:35:32.452037 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:35:32.452387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:35:32.453265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:35:32.453770 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:35:32.454173 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:35:32.463531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:32.464009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:32.464438 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:32.465269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:32.465866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:32.466297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:32.483133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Getting quotas for project 0d643fb7b9314f0a9bb8f2c37f06bb2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:35:32.487319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Getting quotas for user a58cd041c02d46dcb8acf6adb11ee9de and project 0d643fb7b9314f0a9bb8f2c37f06bb2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:35:32.499103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:35:32.501479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:35:32.548859 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-463c1b89-b025-450c-9131-7f450be58057 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.617134 Oct 06 04:35:32.556805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 273/518] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:35:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:35:32.563267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a894f556-4e38-41ae-93dc-4c43565476e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:32.564242 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a894f556-4e38-41ae-93dc-4c43565476e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:32.622847 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a894f556-4e38-41ae-93dc-4c43565476e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:32.631686 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a894f556-4e38-41ae-93dc-4c43565476e8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1245 microversion: 2.1 time: 0.073005 Oct 06 04:35:32.632735 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 246/519] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:32 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:35:32.705763 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:32.706371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:32.713932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:32.714420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:32.714855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:32.715595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:32.716146 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:32.717014 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:32.751405 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:32.751890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:32.752349 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:32.752783 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lazy-loading 'fault' on Instance uuid 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:35:32.794707 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:32.803230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-05d00769-b58f-4043-8696-e3c1ef513e6a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 200 len: 1308 microversion: 2.1 time: 0.101217 Oct 06 04:35:32.803779 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 274/520] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:32 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:33.658181 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:33.658701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:33.669285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:33.669776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:33.670221 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:33.670916 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:33.671399 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:33.671831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:33.732062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:33.739647 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2dd1e01e-d3fa-4373-a7fc-3bf2cd8ab78d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1297 microversion: 2.1 time: 0.085514 Oct 06 04:35:33.740218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 247/521] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:33 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:33.826601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:33.827343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 304e35c3-5e47-4f8b-abf1-ac65e8ebe723] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:33.834035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:33.834520 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:33.834950 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:33.835706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:33.836324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:33.837411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:33.850687 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] HTTP exception thrown: Instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 could not be found. Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Request method failure captured: Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 HTTP/1.1 Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlq6NKmcDxmqhnAY1IbxBQDGLhrDAyJnr0T7osDoUYQurKuntSGunQ55aA9R-l8lTGbxlquq0NV7BlCZs-sb8E3OBstBiixTr5pdCJzK9EAe9AUfT8ku-ZrX9VXFFx8hgi_XrlN8LPrqq6wJDRsXwtLzIdfiYVUw-lCY5rzLFyDXpss Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: d951f19622f24014b0db552eafd4346d Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesSnapshotTestJSON-92529589 Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:35:33.853495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d951f19622f24014b0db552eafd4346d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d951f19622f24014b0db552eafd4346d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d951f19622f24014b0db552eafd4346d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d951f19622f24014b0db552eafd4346d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesSnapshotTestJSON-92529589 Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: d951f19622f24014b0db552eafd4346d Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-92529589 Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesSnapshotTestJSON-92529589-project Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 1bd18015d8334028ada90e42558d7942 Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesSnapshotTestJSON-92529589-project Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 could not be found. Oct 06 04:35:33.854895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '304e35c3-5e47-4f8b-abf1-ac65e8ebe723'} Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 could not be found. Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:35:33.855737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 could not be found. Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 could not be found. Oct 06 04:35:33.856958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:35:33.860461 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Returning 404 to user: Instance 304e35c3-5e47-4f8b-abf1-ac65e8ebe723 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:35:33.860461 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ae72de05-d598-4c83-9a45-f50d92988390 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723" status: 404 len: 111 microversion: 2.1 time: 0.032120 Oct 06 04:35:33.860461 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 275/522] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:33 2022] GET /compute/v2.1/servers/304e35c3-5e47-4f8b-abf1-ac65e8ebe723 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:35:34.763582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:34.765050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:34.770574 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:34.771108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:34.771540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:34.772233 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:34.772685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:34.773105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:34.902615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:34.910201 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-83787957-80f4-4880-b4a5-6183053402d2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.150675 Oct 06 04:35:34.910782 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 248/523] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:34 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:35.933461 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:35.934071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:35.940074 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:35.940550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:35.940979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:35.941665 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:35.942117 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:35.942543 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:36.072412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:36.080129 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b96d3f09-ea93-4672-b1ed-864e24a727ae tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.150632 Oct 06 04:35:36.080908 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 276/524] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:35 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:37.104332 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:37.104935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:37.112539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:37.113033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:37.113467 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:37.114160 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:37.114646 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:37.115101 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:37.243796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:37.251337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3bd801e1-c011-4c4f-897b-360f7af32225 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.151341 Oct 06 04:35:37.251903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 249/525] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:37 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:38.273726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:38.275663 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:38.281955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:38.282649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:38.283122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:38.283835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:38.284292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:38.284753 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:38.420355 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:38.429860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-22d96a1d-8df2-4a47-8cf0-b35f48005389 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.159674 Oct 06 04:35:38.431349 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 277/526] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:38 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:38.588109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-ffd7b7c2-eace-4e6c-b522-e6f86aac7316 req-806d39c2-38c1-421d-b89d-a4b5600f9c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48503bd-a381-4011-8f5d-3a4c45eb8e97", "tag": "e926f146-2ab3-4459-827a-f7a1a9e1e2de"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:38.593384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=40 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:38.599051 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ffd7b7c2-eace-4e6c-b522-e6f86aac7316 req-806d39c2-38c1-421d-b89d-a4b5600f9c8f service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:38.599473 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ffd7b7c2-eace-4e6c-b522-e6f86aac7316 req-806d39c2-38c1-421d-b89d-a4b5600f9c8f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:38.599895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ffd7b7c2-eace-4e6c-b522-e6f86aac7316 req-806d39c2-38c1-421d-b89d-a4b5600f9c8f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:38.611135 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-ffd7b7c2-eace-4e6c-b522-e6f86aac7316 req-806d39c2-38c1-421d-b89d-a4b5600f9c8f service nova] Creating event network-changed:e926f146-2ab3-4459-827a-f7a1a9e1e2de for instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 on hv-cinder-86022 Oct 06 04:35:38.615829 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-ffd7b7c2-eace-4e6c-b522-e6f86aac7316 req-806d39c2-38c1-421d-b89d-a4b5600f9c8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 Oct 06 04:35:38.616409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 250/527] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:35:39.453606 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:39.454216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:39.460392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:39.460883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:39.461355 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:39.462937 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:39.463421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:39.463855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:39.596386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:39.604002 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-be427b2d-b9f6-4b49-8bb4-915b7751cc90 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.154172 Oct 06 04:35:39.604501 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 278/528] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:39 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:40.628292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:40.628992 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:40.635155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:40.635639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:40.636076 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:40.636767 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:40.637219 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:40.637639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:40.771287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:40.779546 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-88e6872e-50ef-4a1d-bf8e-ac56ca9163b7 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.156322 Oct 06 04:35:40.780107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 251/529] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:40 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:41.801417 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:41.801932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:41.808597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:41.809086 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:41.809525 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:41.810245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:41.810702 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:41.811175 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:41.942998 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:41.950641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4b59f375-a8c5-4e8c-a6b5-ebd6c0e937c1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.153174 Oct 06 04:35:41.951234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 279/530] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:41 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:42.974094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:42.974884 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:42.978112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:42.983400 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:42.983883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:42.984318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:42.985004 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:42.985456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:42.985878 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:43.115882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:43.123767 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d46ccae3-578b-44cb-a88b-b57b50ed8a4f tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.153620 Oct 06 04:35:43.124331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 252/531] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:42 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:44.146755 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:44.147391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:44.149829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:44.150477 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=10 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:44.156200 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:44.156685 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:44.157123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:44.157812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:44.158265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:44.158688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:44.286927 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:44.295059 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-efdbe4a8-e2a5-4960-9453-e22aa95f446b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.152091 Oct 06 04:35:44.295623 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 280/532] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:44 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:45.317966 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:45.318570 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:45.325111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:45.325588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:45.326021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:45.326699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:45.327184 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:45.327602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:45.454702 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:45.462149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-37a63838-86a2-47d1-a282-1434da066bd3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.148011 Oct 06 04:35:45.462711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 253/533] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:45 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:46.485108 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:46.485640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:46.487666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:46.492895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:46.494251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:46.494800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:46.495513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:46.495965 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:46.496387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:46.512576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:46.633070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:46.641251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6c0a2d83-131f-4fbf-961a-273d30d65b82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.159975 Oct 06 04:35:46.641921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 281/534] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:46 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:47.663268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:47.663874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:47.666490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 04:35:47.666641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Thu Oct 6 04:35:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 (ip 10.222.0.33) !!! Oct 06 04:35:47.673211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:47.673693 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:47.674123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:47.674808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:47.675344 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:47.675716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:47.806269 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:47.813933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3a8e143f-115e-4e2b-bb82-eb4160d2c5ef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.154385 Oct 06 04:35:47.814607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 254/535] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:47 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:47.879000 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-95267562", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "networks": [{"uuid": "d5ebc260-c361-42d8-80fe-e4538974d21b"}]}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:47.930046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] validate_networks() for [('d5ebc260-c361-42d8-80fe-e4538974d21b', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:35:48.274646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:35:48.275297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:35:48.275774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:35:48.276417 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:35:48.277168 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:35:48.285820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:48.286287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:48.286718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:48.287481 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:48.287935 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:48.288359 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:48.305246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Getting quotas for project d951f19622f24014b0db552eafd4346d. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:35:48.309733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Getting quotas for user 1bd18015d8334028ada90e42558d7942 and project d951f19622f24014b0db552eafd4346d. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:35:48.320376 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:35:48.322494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:35:48.372135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fad0a379-34f9-4f94-8fa2-7aceab359241 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496877 Oct 06 04:35:48.372777 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 282/536] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:35:48.383865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1270d1a7-923e-4620-9471-f183eabf89be tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:48.384466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1270d1a7-923e-4620-9471-f183eabf89be tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:48.442613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1270d1a7-923e-4620-9471-f183eabf89be tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:48.450022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1270d1a7-923e-4620-9471-f183eabf89be tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1217 microversion: 2.1 time: 0.069855 Oct 06 04:35:48.450802 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 255/537] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:48 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:48.836720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:48.837329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:48.843946 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:48.844367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:48.844807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:48.845617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:48.846082 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:48.846497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:48.981096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:48.989431 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5206552b-743c-45f3-b8f0-5d977a70c7a9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.156621 Oct 06 04:35:48.990153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 283/538] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:48 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:49.473418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:49.474145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:49.480756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:49.481177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:49.481605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:49.482284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:49.482728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:49.483184 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:49.547172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:49.554625 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6285ceea-a14b-47df-85ac-9d69c296cd05 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1269 microversion: 2.1 time: 0.085022 Oct 06 04:35:49.555207 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 256/539] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:49 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:50.013636 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:50.014279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:50.022561 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:50.023389 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:50.023944 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:50.024666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:50.026568 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:50.027022 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:50.174938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:50.183234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c1d27097-5825-4434-acc4-09af23365283 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.173267 Oct 06 04:35:50.183805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 284/540] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:50 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:50.577941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:50.578526 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:50.584838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:50.585319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:50.585749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:50.586434 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:50.586882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:50.587332 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:50.777118 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:50.784657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-368c781e-04ee-4287-9867-c626fcab8049 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.210557 Oct 06 04:35:50.785429 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 257/541] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:50 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:51.101185 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-aa48d7fa-a79a-4b64-91af-b3fec48fb9f5 req-872c3457-9c30-48ea-bf5f-262d2622e9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f4a17e-e567-4500-afb6-42c123068571", "tag": "31789d26-26fb-4a11-b756-defeba0c2a40"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:51.111119 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-aa48d7fa-a79a-4b64-91af-b3fec48fb9f5 req-872c3457-9c30-48ea-bf5f-262d2622e9a0 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:51.111612 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-aa48d7fa-a79a-4b64-91af-b3fec48fb9f5 req-872c3457-9c30-48ea-bf5f-262d2622e9a0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:51.112044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-aa48d7fa-a79a-4b64-91af-b3fec48fb9f5 req-872c3457-9c30-48ea-bf5f-262d2622e9a0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:51.124304 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-aa48d7fa-a79a-4b64-91af-b3fec48fb9f5 req-872c3457-9c30-48ea-bf5f-262d2622e9a0 service nova] Creating event network-changed:31789d26-26fb-4a11-b756-defeba0c2a40 for instance 03f4a17e-e567-4500-afb6-42c123068571 on hv-cinder-86022 Oct 06 04:35:51.129049 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-aa48d7fa-a79a-4b64-91af-b3fec48fb9f5 req-872c3457-9c30-48ea-bf5f-262d2622e9a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031586 Oct 06 04:35:51.129643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 285/542] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:35:51.205982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:51.206587 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:51.212436 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:51.212922 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:51.213351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:51.214054 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:51.214594 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:51.215045 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:51.343384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:51.351126 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-32083403-3e5e-4ff8-aa13-fd1e8420c65b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.148993 Oct 06 04:35:51.351696 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 258/543] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:51 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:51.808826 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:51.809526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:51.815767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:51.816277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:51.816714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:51.817405 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:51.817867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:51.818291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:51.946970 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:51.955294 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3da476eb-4b7a-4db6-988f-2f4d3a863a40 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.150910 Oct 06 04:35:51.955852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 286/544] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:51 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:52.375185 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:52.375802 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:52.382194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:52.382678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:52.383153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:52.383844 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:52.384298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:52.384726 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:52.513531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:52.521404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b1cf9f19-3ea7-4fc1-9cce-46993ade808d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.150156 Oct 06 04:35:52.521977 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 259/545] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:52 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:52.835338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-5a38ec45-e666-40a5-b2e9-c8f8e0fa1093 req-50e6d077-81ec-4247-b759-387d8ee242e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48503bd-a381-4011-8f5d-3a4c45eb8e97", "name": "network-vif-plugged", "status": "completed", "tag": "e926f146-2ab3-4459-827a-f7a1a9e1e2de"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:35:52.846424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-5a38ec45-e666-40a5-b2e9-c8f8e0fa1093 req-50e6d077-81ec-4247-b759-387d8ee242e2 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:52.847005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-5a38ec45-e666-40a5-b2e9-c8f8e0fa1093 req-50e6d077-81ec-4247-b759-387d8ee242e2 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:52.847714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-5a38ec45-e666-40a5-b2e9-c8f8e0fa1093 req-50e6d077-81ec-4247-b759-387d8ee242e2 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:52.859232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-5a38ec45-e666-40a5-b2e9-c8f8e0fa1093 req-50e6d077-81ec-4247-b759-387d8ee242e2 service nova] Creating event network-vif-plugged:e926f146-2ab3-4459-827a-f7a1a9e1e2de for instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 on hv-cinder-86022 Oct 06 04:35:52.864040 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-5a38ec45-e666-40a5-b2e9-c8f8e0fa1093 req-50e6d077-81ec-4247-b759-387d8ee242e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032347 Oct 06 04:35:52.864624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 287/546] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:35:52.978519 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:52.979781 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:52.985781 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:52.986265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:52.986703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:52.987425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:52.987880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:52.988307 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:53.120824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:53.128448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2db6614e-4bf5-44bd-8c52-83df58e0a34c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.154648 Oct 06 04:35:53.129008 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 260/547] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:52 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:53.546334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:53.547066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:53.553169 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:53.553659 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:53.554094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:53.554790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:53.555281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:53.555713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:53.690606 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:53.699306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ad100e33-68a8-4d32-a603-176231140257 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.158401 Oct 06 04:35:53.700666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 288/548] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:53 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:54.151217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:54.151856 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:54.158299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:54.158780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:54.159240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:54.159929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:54.160380 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:54.160801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:54.296621 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:54.304206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-bc6e0de7-0d77-43c2-988c-86ed8134a48c tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.157014 Oct 06 04:35:54.304714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 261/549] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:54 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:54.724761 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:54.725375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:54.733369 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:54.733907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:54.734348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:54.735161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:54.735896 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:54.736671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:54.864747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:54.872622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c74fd414-79ae-4646-be13-85b815f4ff7a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.151694 Oct 06 04:35:54.873183 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 289/550] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:54 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:55.328388 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:55.329082 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:55.336195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:55.336757 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:55.337259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:55.338014 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:55.339172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:55.339700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:55.756750 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:55.764507 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a02ba63a-b12e-4fac-b86c-46042f3583ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.440243 Oct 06 04:35:55.765065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 262/551] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:55 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:55.895118 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:55.895768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:55.901727 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:55.902213 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:55.902648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:55.903368 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:55.903824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:55.904248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:56.033203 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:56.040778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5fb7e313-311e-4272-b916-454623f786fa tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.149632 Oct 06 04:35:56.041335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 290/552] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:55 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:56.786477 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:56.787188 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:56.793774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:56.794253 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:56.794684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:56.795413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:56.795866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:56.796286 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:56.926210 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:56.934251 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c50c1257-a538-4e70-a1ec-a6258248023a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.151631 Oct 06 04:35:56.934816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 263/553] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:56 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:57.064150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:57.064710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:57.070688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:57.071201 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:57.071641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:57.072331 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:57.073396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:57.073824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:57.197867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:57.205405 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-698e103e-c789-450b-ba09-b9629f002841 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.145159 Oct 06 04:35:57.205962 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 291/554] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:57 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:57.957573 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:57.958171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:57.965111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:57.965584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:57.966007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:57.966683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:57.967156 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:57.967579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:58.095302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:58.102893 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2e501f6d-01fe-4db8-9a28-9871c9f3f2cf tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.149041 Oct 06 04:35:58.103480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 264/555] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:57 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:58.227885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:58.228509 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:58.234450 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:58.234936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:58.235408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:58.236106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:58.236559 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:58.236985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:58.294907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:58.318563 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=6 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:58.367069 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:58.375497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4c6a2b95-786c-4398-a395-cbd8de0dc771 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.151452 Oct 06 04:35:58.376050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 292/556] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:58 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:59.125632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:59.126233 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:59.128102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:59.134474 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:59.134953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:59.135538 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:59.136132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:59.136575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:59.137092 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:59.141215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:35:59.274019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:59.282395 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-51800d7c-abd3-4de5-89dc-90aec36f8325 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.160509 Oct 06 04:35:59.282978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 265/557] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:59 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:35:59.398731 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:35:59.399301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:35:59.405698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:59.406181 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:59.406618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:59.407348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:35:59.407801 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:35:59.408228 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:35:59.537214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:35:59.545311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-08ab3b34-d297-48bd-a659-3b3b1103b41c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.150424 Oct 06 04:35:59.545876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 293/558] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:35:59 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:00.305863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:00.306494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:00.313024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:00.313505 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:00.313940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:00.314625 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:00.315107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:00.315533 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:00.442206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:00.450476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-74d81470-274b-4bec-a3fd-20acdd2f6a60 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.148458 Oct 06 04:36:00.451063 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 266/559] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:00 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:00.568700 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:00.569318 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:00.576219 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:00.576707 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:00.577147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:00.577844 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:00.578300 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:00.578728 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:00.706516 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:00.714298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6557c2df-678f-41cd-be7c-5a1c39311499 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.149346 Oct 06 04:36:00.714862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 294/560] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:00 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:01.473475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:01.474023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:01.480753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:01.481230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:01.481665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:01.482349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:01.482799 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:01.483255 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:01.610106 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:01.618758 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b4d9baf9-480a-4e7d-8074-e1cce03d7dc4 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.148873 Oct 06 04:36:01.619390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 267/561] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:01 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:01.736705 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:01.737237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:01.743100 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:01.743837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:01.744301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:01.745029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:01.745476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:01.745903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:01.873741 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:01.881519 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4934cb0a-43df-4c18-b6b4-3cff23430301 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.148824 Oct 06 04:36:01.882119 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 295/562] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:01 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:02.641481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:02.642081 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:02.648403 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:02.648876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:02.649311 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:02.649986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:02.650430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:02.650995 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:02.784699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:02.792929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4f7457fc-028a-43a7-86f8-0e75425b5048 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.155200 Oct 06 04:36:02.793491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 268/563] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:02 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:02.905444 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:02.905980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:02.911855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:02.912339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:02.912774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:02.913463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:02.913916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:02.914340 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:03.042530 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:03.050100 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6f62a1b0-36e9-4620-8c97-c618350e0450 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.148602 Oct 06 04:36:03.050666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 296/564] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:02 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:03.671901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-f81ed028-bbea-4e84-94d9-3a2fd45fb21b req-65c05562-ca51-429d-8d94-9724447e0cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4a17e-e567-4500-afb6-42c123068571", "name": "network-vif-plugged", "status": "completed", "tag": "31789d26-26fb-4a11-b756-defeba0c2a40"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:03.683683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-f81ed028-bbea-4e84-94d9-3a2fd45fb21b req-65c05562-ca51-429d-8d94-9724447e0cdc service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:03.684164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-f81ed028-bbea-4e84-94d9-3a2fd45fb21b req-65c05562-ca51-429d-8d94-9724447e0cdc service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:03.684593 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-f81ed028-bbea-4e84-94d9-3a2fd45fb21b req-65c05562-ca51-429d-8d94-9724447e0cdc service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:03.697536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-f81ed028-bbea-4e84-94d9-3a2fd45fb21b req-65c05562-ca51-429d-8d94-9724447e0cdc service nova] Creating event network-vif-plugged:31789d26-26fb-4a11-b756-defeba0c2a40 for instance 03f4a17e-e567-4500-afb6-42c123068571 on hv-cinder-86022 Oct 06 04:36:03.703102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-f81ed028-bbea-4e84-94d9-3a2fd45fb21b req-65c05562-ca51-429d-8d94-9724447e0cdc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Oct 06 04:36:03.703872 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 269/565] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:03.815859 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:03.816480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:03.823185 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:03.823678 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:03.824125 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:03.824823 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:03.825280 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:03.825706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:03.959366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:03.967758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e2ad344f-c96c-4566-adc9-3a8466f97917 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.155791 Oct 06 04:36:03.968328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 297/566] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:03 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:04.074703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:04.075447 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:04.081808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:04.082342 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:04.082780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:04.083559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:04.084020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:04.084447 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:04.212111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:04.220249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-99f196ce-dda3-4ae7-b7fa-44243a8965c2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1371 microversion: 2.1 time: 0.150630 Oct 06 04:36:04.220812 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 270/567] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:04 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:04.991805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:04.992421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:04.998812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:04.999334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:04.999769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:05.000467 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:05.000922 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:05.001400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:05.132452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:05.140621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b7a69e3b-142d-490e-8d77-4551115e392f tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.153152 Oct 06 04:36:05.141182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 298/568] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:04 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:05.243631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:05.244762 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:05.251105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:05.251579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:05.252006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:05.252687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:05.253132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:05.253546 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:05.386719 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:05.395327 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fcb3acd2-d4b6-46ef-b8c7-a1e85cf84fef tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1565 microversion: 2.1 time: 0.155735 Oct 06 04:36:05.395903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 271/569] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:05 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:05.418759 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:05.419285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:05.425076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:05.425553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:05.425984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:05.426676 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:05.427155 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:05.427577 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:05.507699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-17c0ce15-28fc-4043-ad2a-bc6764f251df tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092796 Oct 06 04:36:05.508416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 299/570] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 04:36:05 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:06.163908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:06.164426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:06.171429 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:06.171908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:06.172334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:06.173028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:06.173472 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:06.173889 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:06.310504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:06.318308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3479692b-308d-4730-98b6-15127c49636b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1317 microversion: 2.1 time: 0.158346 Oct 06 04:36:06.318988 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 272/571] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:06 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:06.661854 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-e212c434-3f06-436c-8cac-ee6b6aa169b7 req-9e96983f-2038-4ef0-ab8f-e3caea64f026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48503bd-a381-4011-8f5d-3a4c45eb8e97", "tag": "e926f146-2ab3-4459-827a-f7a1a9e1e2de"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:06.672678 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-e212c434-3f06-436c-8cac-ee6b6aa169b7 req-9e96983f-2038-4ef0-ab8f-e3caea64f026 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:06.673166 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-e212c434-3f06-436c-8cac-ee6b6aa169b7 req-9e96983f-2038-4ef0-ab8f-e3caea64f026 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:06.673599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-e212c434-3f06-436c-8cac-ee6b6aa169b7 req-9e96983f-2038-4ef0-ab8f-e3caea64f026 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:06.685706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-e212c434-3f06-436c-8cac-ee6b6aa169b7 req-9e96983f-2038-4ef0-ab8f-e3caea64f026 service nova] Creating event network-changed:e926f146-2ab3-4459-827a-f7a1a9e1e2de for instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 on hv-cinder-86022 Oct 06 04:36:06.691840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-e212c434-3f06-436c-8cac-ee6b6aa169b7 req-9e96983f-2038-4ef0-ab8f-e3caea64f026 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033581 Oct 06 04:36:06.692433 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 300/572] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:07.344057 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:07.344759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:07.354510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:07.356406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:07.356940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:07.358320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:07.358912 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:07.359461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:07.626447 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:07.642621 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7968659a-9ecb-4e65-a7da-310c23dc85ea tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1505 microversion: 2.1 time: 0.304498 Oct 06 04:36:07.646425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 273/573] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:07 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:36:07.670921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e102530-a31f-403a-9730-d0d80ae7df34", "device": "/dev/sdb"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:07.683811 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:07.692531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:07.693112 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:07.693641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:07.694476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:07.695030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:07.695549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:07.701020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:08.119062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-33dcff1f-6c67-4ae3-a0df-0468caddf58d tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "POST /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451880 Oct 06 04:36:08.125067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 301/574] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:36:07 2022] POST /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:10.306168 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2102042579", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:10.314359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=50 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:10.362141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] validate_networks() for None {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:36:10.637590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:36:10.638038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:36:10.638508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:36:10.638915 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:36:10.639354 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:36:10.648055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:10.648530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:10.648961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:10.649687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:10.650139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:10.650558 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:10.668093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Getting quotas for project f91922bb66cb4f3ba3e78969c3047d0b. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:36:10.677753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Getting quotas for user 700bf1fe3b96441d9aef0a6e95774c69 and project f91922bb66cb4f3ba3e78969c3047d0b. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:36:10.683681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:36:10.685956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:36:10.736024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b995b638-d316-47a0-8b4f-a331ba6fca0e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434194 Oct 06 04:36:10.736667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 274/575] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:36:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:36:10.750271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8b8e8b93-b023-4632-b2f7-0fc620eb2791 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:10.751689 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8b8e8b93-b023-4632-b2f7-0fc620eb2791 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:10.804562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8b8e8b93-b023-4632-b2f7-0fc620eb2791 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:10.812239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8b8e8b93-b023-4632-b2f7-0fc620eb2791 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1215 microversion: 2.1 time: 0.067634 Oct 06 04:36:10.813982 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 302/576] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:10 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:11.837377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:11.837936 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:11.846492 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:11.847078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:11.847523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:11.848219 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:11.848674 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:11.849101 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:11.913276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:11.921223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ec81874d-9125-4af6-bba0-3680afa77f26 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1267 microversion: 2.1 time: 0.088341 Oct 06 04:36:11.921790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 275/577] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:11 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:12.944623 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:12.945346 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:12.953545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:12.954329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:12.954792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:12.955565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:12.956084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:12.956531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:13.110321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:13.118095 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5bd5d804-0bbe-45a9-b855-3e12aa889ace tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.177228 Oct 06 04:36:13.120673 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 303/578] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:12 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:13.591056 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-3ac8e44c-f34c-4a79-890e-346cf6602cbe req-35930807-22eb-405c-9ba8-b601a52837c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7321df24-d7cc-49f5-aa3e-a7d8851413db", "tag": "4e6d771a-767d-4c3e-bf16-610f3958a900"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:13.601353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3ac8e44c-f34c-4a79-890e-346cf6602cbe req-35930807-22eb-405c-9ba8-b601a52837c0 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:13.601822 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3ac8e44c-f34c-4a79-890e-346cf6602cbe req-35930807-22eb-405c-9ba8-b601a52837c0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:13.602491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-3ac8e44c-f34c-4a79-890e-346cf6602cbe req-35930807-22eb-405c-9ba8-b601a52837c0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:13.614561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-3ac8e44c-f34c-4a79-890e-346cf6602cbe req-35930807-22eb-405c-9ba8-b601a52837c0 service nova] Creating event network-changed:4e6d771a-767d-4c3e-bf16-610f3958a900 for instance 7321df24-d7cc-49f5-aa3e-a7d8851413db on hv-cinder-86022 Oct 06 04:36:13.619598 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-3ac8e44c-f34c-4a79-890e-346cf6602cbe req-35930807-22eb-405c-9ba8-b601a52837c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032816 Oct 06 04:36:13.620543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 276/579] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:36:14.142411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:14.142928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:14.149271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:14.149760 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:14.150200 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:14.150902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:14.151522 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:14.151997 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:14.278019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:14.285644 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-64f5f2d6-65cd-4007-aae2-9b14914d75a7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.147312 Oct 06 04:36:14.286204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 304/580] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:14 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:15.308683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:15.309367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:15.315476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:15.315958 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:15.316422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:15.317111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:15.317562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:15.317985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:15.444179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:15.451685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f420f52b-5ff4-427a-b7e0-1547e13001dd tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.148333 Oct 06 04:36:15.452245 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 277/581] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:15 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:16.474060 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:16.474591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:16.481813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:16.482296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:16.482731 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:16.483469 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:16.483925 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:16.484351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:16.612245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:16.620614 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-96774d47-3927-4d1e-87cf-4b18b6834a63 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.149960 Oct 06 04:36:16.621336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 305/582] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:16 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:17.643723 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:17.644324 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:17.650698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:17.655297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:17.655756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:17.656564 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:17.657378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:17.658143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:17.794871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:17.802377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5218ff77-ba1a-4544-9f8e-a55cb1efb469 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.162485 Oct 06 04:36:17.802942 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 278/583] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:17 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:18.826048 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:18.826796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:18.830504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:18.835458 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:18.836034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:18.836545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:18.837325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:18.837851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:18.838342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:18.981788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:18.989497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ce059dde-4195-4685-b60b-1bd20905ed7e tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.167765 Oct 06 04:36:18.990077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 306/584] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:18 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:20.013859 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:20.014877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:20.024915 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:20.025767 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:20.026479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:20.028302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:20.029080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:20.029830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:20.164347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:20.172426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fecde42d-0836-4bad-85e3-476350127d87 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.164059 Oct 06 04:36:20.173002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 279/585] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:20 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:21.195301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:21.195947 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:21.198262 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:21.204332 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:21.204814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:21.205245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:21.205929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:21.206376 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:21.206796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:21.334655 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:21.343035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-698011c1-6ca1-44bf-9271-03093cc1e8f7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.151564 Oct 06 04:36:21.343606 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 307/586] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:21 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:22.365671 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:22.366284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:22.368902 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:22.369553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:22.379478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:22.381259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:22.381700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:22.382404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:22.383587 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:22.384027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:22.518002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:22.525518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8dd4886e-5c16-4728-baf9-d0e078119b1b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.163781 Oct 06 04:36:22.526080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 280/587] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:22 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:23.547606 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:23.548158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:23.554517 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:23.555027 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:23.555459 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:23.556143 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:23.556591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:23.557009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:23.689578 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:23.697371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-771f4e6a-9dfb-4a61-82f0-f8549287d21b tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.154184 Oct 06 04:36:23.697928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 308/588] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:23 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:24.719824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:24.720446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:24.726825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:24.727331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:24.727757 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:24.728437 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:24.728881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:24.729299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:24.860099 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:24.867545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7a65c411-c3f3-467b-ac7d-4c4b6cb4a7e7 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.151546 Oct 06 04:36:24.868103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 281/589] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:24 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:25.890741 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:25.891409 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:25.898305 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:25.898874 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:25.899354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:25.900165 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:25.900697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:25.901092 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:26.036308 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:26.044411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7c568582-803a-4f9b-9af3-a27257423021 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.157910 Oct 06 04:36:26.045185 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 309/590] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:25 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:26.512862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-90c954f4-3683-4599-8c10-7cc526e104a2 req-0456de2e-1e35-4b39-801f-9cfcbaddc464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7321df24-d7cc-49f5-aa3e-a7d8851413db", "name": "network-vif-plugged", "status": "completed", "tag": "4e6d771a-767d-4c3e-bf16-610f3958a900"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:26.522781 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-90c954f4-3683-4599-8c10-7cc526e104a2 req-0456de2e-1e35-4b39-801f-9cfcbaddc464 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:26.523298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-90c954f4-3683-4599-8c10-7cc526e104a2 req-0456de2e-1e35-4b39-801f-9cfcbaddc464 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:26.523774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-90c954f4-3683-4599-8c10-7cc526e104a2 req-0456de2e-1e35-4b39-801f-9cfcbaddc464 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:26.535260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-90c954f4-3683-4599-8c10-7cc526e104a2 req-0456de2e-1e35-4b39-801f-9cfcbaddc464 service nova] Creating event network-vif-plugged:4e6d771a-767d-4c3e-bf16-610f3958a900 for instance 7321df24-d7cc-49f5-aa3e-a7d8851413db on hv-cinder-86022 Oct 06 04:36:26.540101 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-90c954f4-3683-4599-8c10-7cc526e104a2 req-0456de2e-1e35-4b39-801f-9cfcbaddc464 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 Oct 06 04:36:26.540689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 282/591] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:26.864163 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:26.864804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:26.872958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:26.873458 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:26.873900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:26.874656 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:26.875164 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:26.875600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:26.902861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-53b6c79c-7133-4b7b-aeea-4b8ddfbcd941 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/ips" status: 200 len: 144 microversion: 2.1 time: 0.042180 Oct 06 04:36:26.903866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 310/592] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:36:26 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:27.070415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:27.071194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:27.077964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:27.078443 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:27.078919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:27.079622 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:27.080068 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:27.080482 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:27.206918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:27.217228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b008886c-335d-4881-83c3-33c12f1c49a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.150871 Oct 06 04:36:27.217877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 283/593] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:27 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:28.241352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:28.241971 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:28.249840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:28.250327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:28.250764 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:28.251495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:28.251956 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:28.252385 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:28.381421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:28.389541 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8f9160c5-0ca1-4321-a182-f2b2442efe41 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.152083 Oct 06 04:36:28.390098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 311/594] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:28 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:29.412496 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:29.413103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:29.420108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:29.420595 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:29.421032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:29.421727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:29.422183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:29.422615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:29.425258 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=97 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:29.552831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:29.561038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-58f025b0-237b-4ce7-80ec-61aa0f6e1b70 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.152396 Oct 06 04:36:29.561611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 284/595] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:29 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:30.583620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:30.584230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:30.590706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:30.591214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:30.591649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:30.592338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:30.592790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:30.593214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:30.723805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:30.732408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7852f23d-7e99-49a9-a983-9a499fbf0605 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.152544 Oct 06 04:36:30.732966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 312/596] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:30 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:30.827580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:30.828122 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:30.834355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:30.834812 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:30.835285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:30.835964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:30.836410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:30.836828 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:30.860296 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-11374e56-d8b8-448f-89dc-fafdb4464d13 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/ips" status: 200 len: 147 microversion: 2.1 time: 0.036892 Oct 06 04:36:30.860840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 285/597] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:36:30 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:36:31.755227 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:31.755837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:31.762540 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:31.763054 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:31.763542 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:31.764192 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:31.764643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:31.765071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:31.890985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:31.898579 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-74a63dab-35f0-45c4-8017-b39d9bc05d19 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.147287 Oct 06 04:36:31.899153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 313/598] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:31 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:32.920346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:32.920974 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:32.927141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:32.927624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:32.928056 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:32.928742 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:32.929191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:32.929613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:33.131546 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:33.140632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f2f0c8ae-d033-4e81-8197-6f406c0a3c64 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.224597 Oct 06 04:36:33.155173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 286/599] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:32 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:34.165302 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:34.166065 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:34.173460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:34.173947 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:34.174380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:34.175103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:34.175562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:34.175990 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:34.306354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:34.315358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6cf4ef50-cd6b-4fe4-af35-a2deb2c78d8c tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1315 microversion: 2.1 time: 0.154472 Oct 06 04:36:34.316179 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 314/600] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:34 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:34.338456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bce29fb-8a7f-4393-83d6-3ed77db53854"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:34.344391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:34.351280 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:34.351765 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:34.352417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:34.353141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:34.353586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:34.354182 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:34.692119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0f54f5c9-62be-484b-a3fd-4f4bd1a79853 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357512 Oct 06 04:36:34.692738 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 287/601] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:36:34 2022] POST /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:35.338968 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:35.340155 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:35.346535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:35.347044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:35.347482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:35.348186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:35.348636 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:35.349053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:35.458688 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a59e57bd-d6e7-4dea-8e0b-df7fb22eb79d"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:35.461676 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:35.468632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:35.469079 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:35.469503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:35.470272 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:35.470725 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:35.471169 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:35.487968 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:35.496917 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8bd8be21-d5aa-44e6-ab03-448f2ae326a2 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1465 microversion: 2.1 time: 0.160967 Oct 06 04:36:35.497884 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 315/602] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:35 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1465 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:35.570276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:35.570840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:35.577671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:35.578122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:35.578561 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:35.579288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:35.579742 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:35.580168 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:35.605821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:36:35.638936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:35.689314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-105ecc8b-dc87-4c4c-af7c-69958475d118 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 204 len: 0 microversion: 2.1 time: 0.122869 Oct 06 04:36:35.689919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 316/603] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:36:35 2022] DELETE /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:36:35.699371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:35.700407 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:35.706393 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:35.706799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:35.707270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:35.707964 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:35.708416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:35.708840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:35.812684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7fb5f3ab-0a81-4aa4-ae2a-e5ee30dddc4a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359013 Oct 06 04:36:35.813817 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 288/604] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:36:35 2022] POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:36:35.872921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:35.881143 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-277ab8e4-03fd-4731-8e38-6e84e568806d tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1471 microversion: 2.1 time: 0.186621 Oct 06 04:36:35.881699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 317/605] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:35 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:36:36.915279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:36.916035 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:36.923621 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:36.924116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:36.924539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:36.925238 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:36.925868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:36.926284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:37.067149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:37.074806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-07dfae2d-80ba-43ab-bf27-f716cd0cf3de tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1471 microversion: 2.1 time: 0.169723 Oct 06 04:36:37.075482 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 289/606] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:36 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:37.984259 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:37.984777 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:37.990739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:37.991260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:37.991694 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:37.992400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:37.992857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:37.993288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:38.096810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:38.097413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:38.103769 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:38.104257 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:38.104689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:38.105379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:38.105840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:38.106374 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:38.118837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lazy-loading 'services' on Instance uuid 03f4a17e-e567-4500-afb6-42c123068571 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:36:38.233594 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-98a49be4-2a39-4551-9dff-970710fd134b tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571/os-volume_attachments/8e102530-a31f-403a-9730-d0d80ae7df34" status: 202 len: 0 microversion: 2.1 time: 0.253250 Oct 06 04:36:38.234713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 318/607] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:36:37 2022] DELETE /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571/os-volume_attachments/8e102530-a31f-403a-9730-d0d80ae7df34 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:36:38.338945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:38.348479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-49421409-ddbc-4e31-acc2-e956e7fd96c4 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1471 microversion: 2.1 time: 0.255301 Oct 06 04:36:38.361096 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 290/608] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:38 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:36:38.673350 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-afaf7022-b0fa-423f-83cc-fbc03cfaba2f req-28381c69-120e-4658-b492-ec496d70f49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7321df24-d7cc-49f5-aa3e-a7d8851413db", "name": "network-vif-deleted", "tag": "4e6d771a-767d-4c3e-bf16-610f3958a900"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:38.686513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-afaf7022-b0fa-423f-83cc-fbc03cfaba2f req-28381c69-120e-4658-b492-ec496d70f49c service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:38.687034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-afaf7022-b0fa-423f-83cc-fbc03cfaba2f req-28381c69-120e-4658-b492-ec496d70f49c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:38.687475 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-afaf7022-b0fa-423f-83cc-fbc03cfaba2f req-28381c69-120e-4658-b492-ec496d70f49c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:38.700879 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-afaf7022-b0fa-423f-83cc-fbc03cfaba2f req-28381c69-120e-4658-b492-ec496d70f49c service nova] Creating event network-vif-deleted:4e6d771a-767d-4c3e-bf16-610f3958a900 for instance 7321df24-d7cc-49f5-aa3e-a7d8851413db on hv-cinder-86022 Oct 06 04:36:38.706119 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-afaf7022-b0fa-423f-83cc-fbc03cfaba2f req-28381c69-120e-4658-b492-ec496d70f49c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036710 Oct 06 04:36:38.707067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 319/609] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:39.374316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:39.374988 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:39.381350 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:39.381833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:39.382275 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:39.382985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:39.383444 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:39.383872 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:39.415967 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:39.416484 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:39.416911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:39.417342 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lazy-loading 'fault' on Instance uuid 7321df24-d7cc-49f5-aa3e-a7d8851413db {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:36:39.458744 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700bf1fe3b96441d9aef0a6e95774c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91922bb66cb4f3ba3e78969c3047d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:39.467706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-72024de8-7d39-4b17-bed7-ade9e4bfdd69 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 200 len: 1305 microversion: 2.1 time: 0.097791 Oct 06 04:36:39.468509 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 291/610] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:39 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:40.491871 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:40.492560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] [instance: 7321df24-d7cc-49f5-aa3e-a7d8851413db] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:40.499321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:40.499803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:40.500234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:40.500920 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:40.501369 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:40.501789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:40.514652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] HTTP exception thrown: Instance 7321df24-d7cc-49f5-aa3e-a7d8851413db could not be found. Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Request method failure captured: Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db HTTP/1.1 Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPls4yzvNPM3PTpvYv2sgoO36r0bIwt3U3AUUoV7Qt2CuOrOvXqPSq_E36nzbR5HXHbjEYiZXgC8muA10NHzvJBWGgdv9ngC1AokUhWCGfnLwSZOKeA4l3I-WQqErufNWTFnP5r_ZIYXfLGIKwb-Ce17JQGtkPYYyAz5mG28IsakqLV0 Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: f91922bb66cb4f3ba3e78969c3047d0b Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesNegativeTest-204918163 Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:36:40.516263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91922bb66cb4f3ba3e78969c3047d0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91922bb66cb4f3ba3e78969c3047d0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f91922bb66cb4f3ba3e78969c3047d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f91922bb66cb4f3ba3e78969c3047d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesNegativeTest-204918163 Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: f91922bb66cb4f3ba3e78969c3047d0b Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesNegativeTest-204918163 Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesNegativeTest-204918163-project Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 700bf1fe3b96441d9aef0a6e95774c69 Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesNegativeTest-204918163-project Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 7321df24-d7cc-49f5-aa3e-a7d8851413db could not be found. Oct 06 04:36:40.517901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '7321df24-d7cc-49f5-aa3e-a7d8851413db'} Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7321df24-d7cc-49f5-aa3e-a7d8851413db could not be found. Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:36:40.518832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7321df24-d7cc-49f5-aa3e-a7d8851413db could not be found. Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7321df24-d7cc-49f5-aa3e-a7d8851413db could not be found. Oct 06 04:36:40.520339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:36:40.521625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] Returning 404 to user: Instance 7321df24-d7cc-49f5-aa3e-a7d8851413db could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:36:40.521625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8d655ae7-a078-4b09-b721-09a1d18e2b23 tempest-VolumesNegativeTest-204918163 tempest-VolumesNegativeTest-204918163-project] 10.222.0.33 "GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db" status: 404 len: 111 microversion: 2.1 time: 0.030348 Oct 06 04:36:40.521625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 320/611] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:40 2022] GET /compute/v2.1/servers/7321df24-d7cc-49f5-aa3e-a7d8851413db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:36:42.349102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3a7dd619-4ec3-4ba2-a89a-c792592d7a33 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: .version_select at 0x7f0c42adbb80>, body: {"keypair": {"name": "tempest-keypair-1469105873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdVLbs3PNVbTOEtYy2HLS0UGxkSXNQG3Xp9qH3B90zdgO/jfiESpfIab8J1j8/tA0uBqJ3I1pXNMQj+Inzgm/3zgxig0Hiv9pAcmipinkswL6dU2r6xCkbUtNkfmbDYng=="}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:42.357117 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:42.368008 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-3a7dd619-4ec3-4ba2-a89a-c792592d7a33 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:36:42.372834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-3a7dd619-4ec3-4ba2-a89a-c792592d7a33 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for user f68d73b5efc74b3380429cf72e506905 and project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:36:42.399314 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3a7dd619-4ec3-4ba2-a89a-c792592d7a33 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053913 Oct 06 04:36:42.399923 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 292/612] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:36:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:43.814821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1409346649", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45c9d327-544f-44d6-be7e-529008b00a93"}], "security_groups": [{"name": "tempest-securitygroup--1103444930"}], "key_name": "tempest-keypair-1469105873", "user_data": "}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:43.920241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] validate_networks() for [('45c9d327-544f-44d6-be7e-529008b00a93', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:36:44.288402 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:36:44.288819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:36:44.289283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:36:44.289748 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:36:44.290157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:36:44.299392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:44.299877 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:44.300346 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:44.301069 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:44.301524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:44.301950 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:44.318724 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:36:44.322672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for user f68d73b5efc74b3380429cf72e506905 and project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:36:44.334439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:36:44.336735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:36:44.391514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-868eb7b8-0e4c-4b93-a8e3-d34739ee8ecf tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580765 Oct 06 04:36:44.392333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 321/613] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:36:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:36:44.403483 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-286ad421-cf06-4fe6-8c58-2c644e9ee075 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:44.404193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-286ad421-cf06-4fe6-8c58-2c644e9ee075 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:44.471858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-286ad421-cf06-4fe6-8c58-2c644e9ee075 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:44.479460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-286ad421-cf06-4fe6-8c58-2c644e9ee075 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1242 microversion: 2.1 time: 0.079875 Oct 06 04:36:44.480486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 293/614] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:44 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:45.504091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:45.504706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:45.511040 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:45.511553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:45.512015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:45.513310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:45.513892 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:45.514290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:45.579340 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:45.586806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4bf38030-74d0-4e70-87e3-bdeac1ac1f5d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1294 microversion: 2.1 time: 0.086931 Oct 06 04:36:45.587563 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 322/615] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:45 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:46.611518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:46.612875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:46.620621 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:46.621109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:46.622054 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:46.623134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:46.623592 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:46.624015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:46.826899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:46.834874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-877286ed-5938-4677-84be-189b87c10dcb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.228481 Oct 06 04:36:46.835675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 294/616] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:46 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:47.351557 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-df58f4e4-5282-43d1-92be-3de601b0bfa5 req-d8d1a8c2-153c-404c-b8d3-3a5018564c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0802344-0cf0-48a1-b4cc-b2495c860ac2", "tag": "9c5e0f8b-c1b2-458f-a4b9-3a77bbe709f2"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:47.366752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-df58f4e4-5282-43d1-92be-3de601b0bfa5 req-d8d1a8c2-153c-404c-b8d3-3a5018564c1f service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:47.368682 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-df58f4e4-5282-43d1-92be-3de601b0bfa5 req-d8d1a8c2-153c-404c-b8d3-3a5018564c1f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:47.369310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-df58f4e4-5282-43d1-92be-3de601b0bfa5 req-d8d1a8c2-153c-404c-b8d3-3a5018564c1f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:47.382480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-df58f4e4-5282-43d1-92be-3de601b0bfa5 req-d8d1a8c2-153c-404c-b8d3-3a5018564c1f service nova] Creating event network-changed:9c5e0f8b-c1b2-458f-a4b9-3a77bbe709f2 for instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 on hv-cinder-86022 Oct 06 04:36:47.390144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-df58f4e4-5282-43d1-92be-3de601b0bfa5 req-d8d1a8c2-153c-404c-b8d3-3a5018564c1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043460 Oct 06 04:36:47.390749 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 323/617] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:47.857948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:47.858551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:47.865486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:47.865608 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:47.865972 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:47.866669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:47.867147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:47.867571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:48.001906 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:48.009867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c8bc522a-e432-442e-bc0c-6e7233791dc6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.155858 Oct 06 04:36:48.010435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 295/618] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:47 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:49.033197 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:49.033891 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:49.036265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:49.041610 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:49.042093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:49.042521 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:49.044101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:49.044556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:49.044975 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:49.176729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:49.185877 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-841d9c33-9ae2-45d5-a806-dae12c6cc168 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.156831 Oct 06 04:36:49.186469 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 324/619] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:49 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:50.207832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:50.208442 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:50.214984 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:50.215916 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:50.216052 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:50.216745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:50.217195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:50.217615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:50.346028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:50.353578 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-62e6a4a0-f5ff-4447-8b56-f6cb4f2a0a27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.149568 Oct 06 04:36:50.354137 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 296/620] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:50 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:51.376154 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:51.377124 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:51.383461 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:51.383939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:51.384372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:51.385058 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:51.385516 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:51.385935 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:51.514366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:51.521870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-defa439d-05fb-4d3e-b2ff-a881f4e9337c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.149543 Oct 06 04:36:51.522425 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 325/621] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:51 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:52.543561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:52.544161 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:52.550492 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:52.550982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:52.551427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:52.552138 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:52.552586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:52.553002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:52.689325 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:52.696877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c87498c5-9e16-4fba-a206-b1a833864760 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.157151 Oct 06 04:36:52.697665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 297/622] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:52 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:53.719480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:53.720086 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:53.726354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:53.726837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:53.727315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:53.728004 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:53.728453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:53.728875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:53.867039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:53.874386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c66f0199-44bc-4693-a709-bfcc23535778 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.158815 Oct 06 04:36:53.874974 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 326/623] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:53 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:54.896830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:54.897423 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:54.899885 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:54.906028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:54.906516 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:54.906951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:54.907683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:54.908135 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:54.908706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:55.043844 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:55.051681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f1bf24eb-e97e-4b46-b7e4-d32c0237b511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.158501 Oct 06 04:36:55.053097 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 298/624] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:54 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:56.078288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:56.078916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:56.094631 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:56.095321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=6 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:56.101960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:56.102414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:56.102855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:56.103672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:56.104122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:56.104549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:56.233208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:56.240742 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6b60f6f8-f3ba-4dab-ac02-1196372e6a37 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.167808 Oct 06 04:36:56.241315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 327/625] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:56 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:36:56.705116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-8b69f227-ac75-40fa-84ef-5443880cf661 req-a599ce2e-a0a5-4079-8d18-b2eea0edb605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0802344-0cf0-48a1-b4cc-b2495c860ac2", "name": "network-vif-plugged", "status": "completed", "tag": "9c5e0f8b-c1b2-458f-a4b9-3a77bbe709f2"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:56.714740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-8b69f227-ac75-40fa-84ef-5443880cf661 req-a599ce2e-a0a5-4079-8d18-b2eea0edb605 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:56.715360 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-8b69f227-ac75-40fa-84ef-5443880cf661 req-a599ce2e-a0a5-4079-8d18-b2eea0edb605 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:56.715971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-8b69f227-ac75-40fa-84ef-5443880cf661 req-a599ce2e-a0a5-4079-8d18-b2eea0edb605 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:56.727268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-8b69f227-ac75-40fa-84ef-5443880cf661 req-a599ce2e-a0a5-4079-8d18-b2eea0edb605 service nova] Creating event network-vif-plugged:9c5e0f8b-c1b2-458f-a4b9-3a77bbe709f2 for instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 on hv-cinder-86022 Oct 06 04:36:56.733270 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-8b69f227-ac75-40fa-84ef-5443880cf661 req-a599ce2e-a0a5-4079-8d18-b2eea0edb605 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031697 Oct 06 04:36:56.734030 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 299/626] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:36:57.216264 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-93268998-30a9-44b4-a4da-d46864666dfb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:36:57.222699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93268998-30a9-44b4-a4da-d46864666dfb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.223222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93268998-30a9-44b4-a4da-d46864666dfb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.223672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93268998-30a9-44b4-a4da-d46864666dfb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.270104 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:57.270990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:57.279256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.280491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.280940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.282650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.283289 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.283720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.285640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-93268998-30a9-44b4-a4da-d46864666dfb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Going to try to stop instance {{(pid=127097) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 04:36:57.334344 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-93268998-30a9-44b4-a4da-d46864666dfb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/action" status: 202 len: 0 microversion: 2.1 time: 0.122378 Oct 06 04:36:57.335008 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 328/627] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:36:57 2022] POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:36:57.343710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:57.344404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:57.350763 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.351329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.351796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.352509 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.352966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.353432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.437740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:57.440571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:36:57.451127 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2bcaff08-62cc-4eea-882a-b3c4c981c57d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.188410 Oct 06 04:36:57.451990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 300/628] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:57 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:36:57.456687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:57.457176 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:57.463678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.464200 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.464741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.466029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.466569 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.467088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.493958 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:36:57.498016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:57.506262 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-afcd9926-b8e6-439d-9464-673f57176f69 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.167054 Oct 06 04:36:57.506822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 329/629] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:57 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:36:57.568432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6245d846-0e8c-4344-a0e9-21c1fbdeb7d5 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 204 len: 0 microversion: 2.1 time: 0.115118 Oct 06 04:36:57.569007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 301/630] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:36:57 2022] DELETE /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:36:57.578120 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:57.578729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:57.584671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.585152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.585582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.586272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:57.586723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:57.587178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:57.727501 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:57.736244 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ed6c7951-763c-4a49-a203-55d99da5ebf6 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1557 microversion: 2.1 time: 0.162910 Oct 06 04:36:57.736806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 330/631] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:57 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:58.476672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:58.477302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:58.484126 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:58.484615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:58.485083 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:58.485782 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:58.486240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:58.486667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:58.529463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:58.530165 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:58.537085 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:58.537568 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:58.538271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:58.538982 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:58.539439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:58.539868 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:58.622192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:58.631589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-338136ef-795f-47ac-ba47-a8d67d036e35 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.159194 Oct 06 04:36:58.632261 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 302/632] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:58 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:36:58.669386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:58.677507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-00aaf71f-33fc-40ab-97a0-70f251f897e9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.151863 Oct 06 04:36:58.678072 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 331/633] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:58 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:36:58.758783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:58.759339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:58.765298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:58.765778 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:58.766215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:58.766899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:58.767382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:58.767803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:58.898192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:58.905919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-dede47fb-0ace-4e8e-9053-a3efd084cbfc tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1511 microversion: 2.1 time: 0.151085 Oct 06 04:36:58.906509 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 303/634] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:58 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:59.655272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:59.655882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:59.662196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:59.662678 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:59.663166 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:59.663886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:59.664341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:59.664766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:59.701377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:59.702115 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:59.708770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:59.709251 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:59.709682 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:59.710381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:59.710836 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:59.711278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:59.798472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:59.806311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c8bbdbc9-cfc5-4c55-b1bf-a4cc842053e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1368 microversion: 2.1 time: 0.155519 Oct 06 04:36:59.806882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 332/635] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:59 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:59.840757 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:36:59.848941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ff87c223-8ad0-462d-b5ae-f5b0abe8b328 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.151825 Oct 06 04:36:59.849503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 304/636] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:59 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:36:59.931979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:36:59.932526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:36:59.938977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:59.939465 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:59.939904 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:36:59.940600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:36:59.941060 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:36:59.941490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:00.068989 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:00.071330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:00.079704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8151c435-301b-4da0-b933-0f9663b0312a tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1511 microversion: 2.1 time: 0.151624 Oct 06 04:37:00.080272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 333/637] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:36:59 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:00.652191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:00.652683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:00.658669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:00.659195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:00.659631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:00.660318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:00.660770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:00.661191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:00.683588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2334cbdc-34b8-4cd6-84fb-30328cd2c5ea tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/ips" status: 200 len: 151 microversion: 2.20 time: 0.035266 Oct 06 04:37:00.684141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 305/638] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Oct 6 04:37:00 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 04:37:00.830381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:00.831071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:00.838663 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:00.839299 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:00.839639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:00.840361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:00.840904 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:00.841357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:00.873883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:00.874497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:00.883422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:00.883924 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:00.884363 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:00.885779 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:00.889542 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:00.890069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:01.016983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:01.025703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5b7fbd0c-5945-4f00-8f8d-46964621dd76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1556 microversion: 2.1 time: 0.198993 Oct 06 04:37:01.026938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 334/639] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:00 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:37:01.047837 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:01.050588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:01.051116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:01.056888 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:01.057055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-86c76c26-e8d8-4e30-a27c-487e6cb68052 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.188296 Oct 06 04:37:01.057387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:01.057572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 306/640] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:00 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:01.058143 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:01.058858 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:01.059383 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:01.059807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:01.103912 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:01.104553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:01.110513 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:01.111019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:01.111452 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:01.112141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:01.112590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:01.113012 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:01.136976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2de493a4-72b7-47a7-9ca1-b0b4cec8c4d1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090490 Oct 06 04:37:01.138156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 335/641] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 04:37:01 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:37:01.489897 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:01.497963 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5840ee2c-bbb1-4c78-88e3-054026e29716 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1511 microversion: 2.1 time: 0.397798 Oct 06 04:37:01.498543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 307/642] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:01 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:37:02.041881 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-af352032-f847-4df6-8d82-523488302f98 req-4ea96910-248a-4166-accd-2930b1911d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4a17e-e567-4500-afb6-42c123068571", "name": "network-vif-deleted", "tag": "31789d26-26fb-4a11-b756-defeba0c2a40"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:02.055567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-af352032-f847-4df6-8d82-523488302f98 req-4ea96910-248a-4166-accd-2930b1911d92 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.056245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-af352032-f847-4df6-8d82-523488302f98 req-4ea96910-248a-4166-accd-2930b1911d92 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.056829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-af352032-f847-4df6-8d82-523488302f98 req-4ea96910-248a-4166-accd-2930b1911d92 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.085888 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-af352032-f847-4df6-8d82-523488302f98 req-4ea96910-248a-4166-accd-2930b1911d92 service nova] Creating event network-vif-deleted:31789d26-26fb-4a11-b756-defeba0c2a40 for instance 03f4a17e-e567-4500-afb6-42c123068571 on hv-cinder-86022 Oct 06 04:37:02.095237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:02.097006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:02.097416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-af352032-f847-4df6-8d82-523488302f98 req-4ea96910-248a-4166-accd-2930b1911d92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060810 Oct 06 04:37:02.099428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 336/643] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:37:02.107686 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.108267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.108711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.110080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.110546 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.110986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.126619 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-a9cece84-84b7-4782-8978-91c6725d4248 req-534c3393-53b9-434f-935c-3d73bb6770af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0802344-0cf0-48a1-b4cc-b2495c860ac2", "tag": "9c5e0f8b-c1b2-458f-a4b9-3a77bbe709f2"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:02.136409 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-a9cece84-84b7-4782-8978-91c6725d4248 req-534c3393-53b9-434f-935c-3d73bb6770af service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.138005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-a9cece84-84b7-4782-8978-91c6725d4248 req-534c3393-53b9-434f-935c-3d73bb6770af service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.138871 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-a9cece84-84b7-4782-8978-91c6725d4248 req-534c3393-53b9-434f-935c-3d73bb6770af service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.150022 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-a9cece84-84b7-4782-8978-91c6725d4248 req-534c3393-53b9-434f-935c-3d73bb6770af service nova] Creating event network-changed:9c5e0f8b-c1b2-458f-a4b9-3a77bbe709f2 for instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 on hv-cinder-86022 Oct 06 04:37:02.165250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-a9cece84-84b7-4782-8978-91c6725d4248 req-534c3393-53b9-434f-935c-3d73bb6770af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043204 Oct 06 04:37:02.166993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 337/644] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:37:02.259650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:02.269510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7e123104-b1c8-4bba-942c-fea31cf9c7e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.181173 Oct 06 04:37:02.270292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 308/645] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:02 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:02.521071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:02.522098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:02.529280 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.530497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.531043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.531845 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.532361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.532915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.571063 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.571896 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.572013 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.572416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lazy-loading 'fault' on Instance uuid 03f4a17e-e567-4500-afb6-42c123068571 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:37:02.618686 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd18015d8334028ada90e42558d7942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd951f19622f24014b0db552eafd4346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:02.627600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c92e42b7-7459-4be6-b4c5-f3b13d9e41c1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 200 len: 1307 microversion: 2.1 time: 0.110557 Oct 06 04:37:02.628382 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 338/646] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:02 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:02.764602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:02.765132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:02.771425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.771908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.772352 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.773018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:02.773466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:02.773882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:02.796520 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lazy-loading 'flavor' on Instance uuid 74c46bbc-e699-4b17-99e5-d6a70df92e2c {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:37:02.995973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-48687c7b-2fe7-4d4a-92bf-38749fb3acad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/action" status: 202 len: 0 microversion: 2.20 time: 0.236323 Oct 06 04:37:02.996580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 309/647] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Oct 6 04:37:02 2022] POST /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:37:03.004986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:03.005923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:03.012274 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:03.012882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:03.013428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:03.014231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:03.014756 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:03.015289 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:03.181096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:03.189648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:03.191124 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:03.192482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bcedb97b-4d67-46ce-b448-f18420d7854f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.191481 Oct 06 04:37:03.193052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 339/648] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:02 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:37:03.294824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:03.296215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:03.302733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:03.303479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:03.303913 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:03.304777 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:03.305397 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:03.305832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:03.467097 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:03.475205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ffccfdcf-2809-4a90-81be-c43d1aef8faa tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.185668 Oct 06 04:37:03.475774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 310/649] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:03 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:03.651396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:03.651918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] [instance: 03f4a17e-e567-4500-afb6-42c123068571] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:03.658269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:03.658754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:03.659229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:03.659928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:03.660389 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:03.660816 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:03.676097 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] HTTP exception thrown: Instance 03f4a17e-e567-4500-afb6-42c123068571 could not be found. Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Request method failure captured: Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 HTTP/1.1 Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlq6NKmcDxmqhnAY1IbxBQDGLhrDAyJnr0T7osDoUYQurKuntSGunQ55aA9R-l8lTGbxlquq0NV7BlCZs-sb8E3OBstBiixTr5pdCJzK9EAe9AUfT8ku-ZrX9VXFFx8hgi_XrlN8LPrqq6wJDRsXwtLzIdfiYVUw-lCY5rzLFyDXpss Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: d951f19622f24014b0db552eafd4346d Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-VolumesSnapshotTestJSON-92529589 Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:37:03.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d951f19622f24014b0db552eafd4346d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d951f19622f24014b0db552eafd4346d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d951f19622f24014b0db552eafd4346d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d951f19622f24014b0db552eafd4346d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-VolumesSnapshotTestJSON-92529589 Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: d951f19622f24014b0db552eafd4346d Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-92529589 Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-VolumesSnapshotTestJSON-92529589-project Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 1bd18015d8334028ada90e42558d7942 Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-VolumesSnapshotTestJSON-92529589-project Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 03f4a17e-e567-4500-afb6-42c123068571 could not be found. Oct 06 04:37:03.679326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '03f4a17e-e567-4500-afb6-42c123068571'} Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f4a17e-e567-4500-afb6-42c123068571 could not be found. Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:37:03.680235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f4a17e-e567-4500-afb6-42c123068571 could not be found. Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f4a17e-e567-4500-afb6-42c123068571 could not be found. Oct 06 04:37:03.681820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:37:03.683226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] Returning 404 to user: Instance 03f4a17e-e567-4500-afb6-42c123068571 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:37:03.683226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4337884f-fa55-40db-9b8a-fb4d8bceffd1 tempest-VolumesSnapshotTestJSON-92529589 tempest-VolumesSnapshotTestJSON-92529589-project] 10.222.0.33 "GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571" status: 404 len: 111 microversion: 2.1 time: 0.031591 Oct 06 04:37:03.683226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 340/650] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:03 2022] GET /compute/v2.1/servers/03f4a17e-e567-4500-afb6-42c123068571 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:37:04.218211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:04.218832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:04.224755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:04.225243 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:04.225678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:04.226369 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:04.226819 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:04.227268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:04.360869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:04.369166 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:04.370596 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:04.372093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ca7b52b2-626d-4241-8c24-0cce7c24485c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.158064 Oct 06 04:37:04.372471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 311/651] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:04 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:04.499316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:04.499855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:04.506244 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:04.506725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:04.507201 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:04.507894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:04.508351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:04.508780 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:04.641319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:04.649458 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3186e483-0beb-418e-a2d1-637550b5771f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.154183 Oct 06 04:37:04.650019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 341/652] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:04 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:05.398077 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:05.398717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:05.405889 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:05.406365 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:05.406801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:05.407522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:05.407973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:05.408393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:05.537875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:05.545811 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:05.547248 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:05.548397 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-15b55304-487d-40d5-8959-735a29c77507 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.154648 Oct 06 04:37:05.548958 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 312/653] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:05 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:05.673686 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:05.674297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:05.680786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:05.681278 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:05.681714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:05.682411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:05.682867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:05.683320 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:05.813075 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:05.821116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-415101dc-e20f-47db-b329-365b2cf0e266 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.151464 Oct 06 04:37:05.821679 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 342/654] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:05 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:06.573009 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:06.573611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:06.580217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:06.580704 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:06.581136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:06.581827 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:06.582308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:06.582736 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:06.711692 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:06.720312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:06.721759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:06.722925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d1660071-c5ec-4008-8e06-72eae3b72be9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.153779 Oct 06 04:37:06.723522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 313/655] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:06 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:06.845345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:06.845957 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:06.852410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:06.852898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:06.853342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:06.854038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:06.854497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:06.854924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:06.981703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:06.992248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c7740619-503d-46b2-acdb-ad1c145c78f1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.151301 Oct 06 04:37:06.992820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 343/656] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:06 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:07.749578 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:07.750195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:07.756734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:07.757317 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:07.757762 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:07.758458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:07.758909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:07.759359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:07.762146 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:07.894465 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:07.902968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:07.904410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:07.905601 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b2e59d8e-e819-4358-98a5-077789c8aba3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.160691 Oct 06 04:37:07.906165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 314/657] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:07 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:08.015669 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:08.016215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:08.022258 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:08.022746 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:08.023204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:08.023893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:08.024347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:08.024764 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:08.159594 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:08.167723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-367fa594-fdad-419c-8f00-0edd7add5932 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.156134 Oct 06 04:37:08.168295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 344/658] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:08 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:08.937502 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:08.938100 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:08.944460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:08.944933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:08.945363 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:08.946040 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:08.946485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:08.946900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:09.191796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:09.192336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:09.198809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:09.199325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:09.199754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:09.200534 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:09.200989 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:09.201414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:09.245913 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:09.255318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:09.256804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:09.258222 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b1f7634f-aa5b-4ee0-bba4-cab729ec1e20 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.325282 Oct 06 04:37:09.259504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 315/659] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:08 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:09.334666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:09.343549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d2104821-1557-4138-a14b-22e0ca005d64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.155584 Oct 06 04:37:09.344110 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 345/660] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:09 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:37:10.284039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:10.284645 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:10.291068 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:10.291555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:10.291985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:10.292679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:10.293130 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:10.293551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:10.366888 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:10.367640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:10.374541 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:10.375941 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:10.376588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:10.377367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:10.378254 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:10.379257 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:10.429479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:10.437899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:10.439489 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:10.440652 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b143d267-1f19-4740-b588-2518fd0eeb86 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.161035 Oct 06 04:37:10.441208 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 316/661] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:10 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:10.582133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:10.600059 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a2819dec-efe6-4399-97ea-6c9b6ad0d2ab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.227860 Oct 06 04:37:10.603004 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 346/662] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:10 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:11.465708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:11.466290 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:11.473485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:11.473966 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:11.474400 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:11.475115 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:11.475568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:11.475997 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:11.602830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:11.610831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:11.612301 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:11.613465 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-49e52f49-8411-4d6d-a4b3-850f2dd15514 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.151714 Oct 06 04:37:11.614023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 317/663] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:11 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:11.615567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:11.616288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:11.622919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:11.623455 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:11.623913 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:11.624590 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:11.625046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:11.625471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:11.755179 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:11.762064 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-851792d7-9236-440f-9238-afa1a14fe801 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.150476 Oct 06 04:37:11.762706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 347/664] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:11 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:37:12.639566 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:12.640960 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:12.643258 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:12.648504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:12.648984 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:12.649415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:12.650102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:12.650549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:12.650999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:12.781900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:12.785423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:12.786031 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:12.790294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:12.791752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:12.792336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:12.792819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:12.792925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6edc3324-b82e-4bcb-90cc-7ac725aa4885 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.157324 Oct 06 04:37:12.793250 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:12.793448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 318/665] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:12 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:12.793947 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:12.794398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:12.794820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:12.929345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:12.938353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-191edb7b-1e9c-4167-b942-220468de80d5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.156723 Oct 06 04:37:12.938925 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 348/666] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:12 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:37:13.818919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:13.819537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:13.825849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:13.826322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:13.826748 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:13.828012 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:13.828465 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:13.828883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:13.957217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:13.961349 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:13.962051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:13.965328 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:13.966790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:13.968022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-650c9231-a724-4409-a3f4-0892bc1dc434 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.152967 Oct 06 04:37:13.968591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 319/667] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:13 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:13.968723 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:13.969296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:13.969921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:13.970629 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:13.971138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:13.971570 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:14.103560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:14.112352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2136a1bb-c6e9-4001-8ed2-4a3dc9884601 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1722 microversion: 2.1 time: 0.154918 Oct 06 04:37:14.112920 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 349/668] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:13 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:37:14.992261 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:14.992876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:14.999946 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:15.000565 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:15.000995 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:15.001677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:15.002124 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:15.002540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:15.136284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:15.136476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:15.136994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:15.143653 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:15.144142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:15.144413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:15.144581 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:15.145291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:15.145749 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:15.145858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:15.146181 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:15.146983 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-35232167-abad-4a55-9e7b-9dd99021bb4c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.158641 Oct 06 04:37:15.147549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 320/669] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:14 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:15.272147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:15.280214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-443aca07-9e7c-4a7a-b4a0-499d918a252f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1699 microversion: 2.1 time: 0.147661 Oct 06 04:37:15.280818 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 350/670] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:15 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1699 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:37:15.302984 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-35e61c50-ff31-439d-b30c-6de4fa6b2640 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:15.308788 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35e61c50-ff31-439d-b30c-6de4fa6b2640 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:15.309266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35e61c50-ff31-439d-b30c-6de4fa6b2640 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:15.309697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-35e61c50-ff31-439d-b30c-6de4fa6b2640 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:15.368230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-35e61c50-ff31-439d-b30c-6de4fa6b2640 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Going to try to start instance {{(pid=127098) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 04:37:15.414324 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-35e61c50-ff31-439d-b30c-6de4fa6b2640 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/action" status: 202 len: 0 microversion: 2.1 time: 0.114956 Oct 06 04:37:15.414921 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 321/671] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:37:15 2022] POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:37:15.435416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:15.436059 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:15.442321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:15.442806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:15.443288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:15.443974 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:15.444454 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:15.444876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:15.580272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:15.588370 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7268a1b2-1041-4eab-95b4-42e8f0a8604a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1708 microversion: 2.1 time: 0.159369 Oct 06 04:37:15.588925 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 351/672] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:15 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:37:16.173053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:16.173743 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:16.179873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:16.180359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:16.180794 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:16.181477 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:16.181927 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:16.182346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:16.314821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:16.322838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:16.324427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:16.325579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-68dd68cb-f3ae-49e3-9b3e-5b4100ad9a31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.157343 Oct 06 04:37:16.326144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 322/673] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:16 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:16.612387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:16.612988 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:16.619842 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:16.620334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:16.620774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:16.621480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:16.621961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:16.622388 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:16.638347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:16.750418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:16.758546 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bcc6df1a-2eb0-436a-aee1-f39a706e037a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1708 microversion: 2.1 time: 0.150476 Oct 06 04:37:16.759130 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 352/674] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:16 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:17.349946 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:17.350551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:17.356989 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:17.357470 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:17.357900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:17.358585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:17.359063 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:17.359481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:17.488193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:17.496821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:17.498249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:17.499588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9a1ee2e2-3bc6-454a-aac8-cab6eb89cfaa tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.153297 Oct 06 04:37:17.500332 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 323/675] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:17 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:17.781301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:17.781810 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:17.788316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:17.788803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:17.789238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:17.789932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:17.790391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:17.790814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:17.920257 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:17.932355 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fb075f5e-6e1f-4569-8105-05daf2e882cb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1708 microversion: 2.1 time: 0.154922 Oct 06 04:37:17.932920 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 353/676] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:17 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:18.524795 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:18.525406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:18.532651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:18.533141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:18.533582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:18.534282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:18.534734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:18.535186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:18.666086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:18.674514 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:18.675973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:18.677165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-28d473ee-586b-470f-8642-ef2f7b26b7b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.156145 Oct 06 04:37:18.677727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 324/677] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:18 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:18.955498 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:18.956102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:18.962440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:18.962922 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:18.963386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:18.964077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:18.964528 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:18.964949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:19.092569 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:19.100911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-17c42ccd-a86f-4dd2-9aae-3ecc9d93607d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1708 microversion: 2.1 time: 0.149462 Oct 06 04:37:19.101488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 354/678] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:18 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:19.703451 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:19.704065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:19.710416 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:19.710901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:19.711371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:19.712072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:19.712530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:19.712958 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:19.850142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:19.857442 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:19.859402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:19.860848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5ba7adfc-e2a1-4e27-9472-c1c666e7096a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.162180 Oct 06 04:37:19.861412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 325/679] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:19 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:20.123143 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:20.123745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:20.126172 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=64 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:20.131350 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:20.131893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:20.132324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:20.133015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:20.133465 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:20.133883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:20.263351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:20.272432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fda87abf-2de5-4c65-8068-8aa84c9c406f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1708 microversion: 2.1 time: 0.153136 Oct 06 04:37:20.273002 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 355/680] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:20 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:20.887349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:20.887949 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:20.894755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:20.895271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:20.895702 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:20.896397 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:20.896850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:20.897309 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:21.035610 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:21.043727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:21.045238 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:21.046526 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-94253277-5e0e-4207-a8ba-661821cf70ba tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.163060 Oct 06 04:37:21.047033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 326/681] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:20 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:21.296329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:21.297455 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:21.303926 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:21.304412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:21.304860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:21.305578 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:21.306051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:21.306478 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:21.446219 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:21.455182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-519abbc1-9a15-49d9-8437-3b5981a65f1d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1712 microversion: 2.1 time: 0.162748 Oct 06 04:37:21.455755 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 356/682] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:21 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1712 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:22.071446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:22.072078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:22.078636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:22.079153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:22.079587 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:22.080270 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:22.080721 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:22.081142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:22.215808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:22.234193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:22.235895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:22.237102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1ba91240-61d3-4e36-91e4-03ade23de4a0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.169527 Oct 06 04:37:22.237691 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 327/683] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:22 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:23.263188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:23.263795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:23.270639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:23.271160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:23.271595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:23.272324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:23.273145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:23.273572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:23.420397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:23.428343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:23.429762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:23.430902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-da6f811f-877b-42ef-a514-aa0642a16b6e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.171570 Oct 06 04:37:23.431508 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 357/684] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:23 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:24.455642 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:24.456318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:24.463057 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:24.463545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:24.463979 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:24.464695 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:24.465266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:24.465705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:24.598855 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:24.606816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:24.608292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:24.609440 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-440d8c1c-49d2-4dd3-9404-ec95e322811f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.157813 Oct 06 04:37:24.610039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 328/685] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:24 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:25.636301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:25.636976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:25.643828 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:25.644323 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:25.644759 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:25.645483 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:25.645937 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:25.646363 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:26.004727 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:26.012876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:26.014323 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:26.015519 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-72d3329c-5311-4e4b-9388-2381132e5dae tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1743 microversion: 2.20 time: 0.382996 Oct 06 04:37:26.016384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 358/686] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:25 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1743 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:27.144705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:27.145318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:27.151156 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:27.151635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:27.152066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:27.152750 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:27.153193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:27.153613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:27.285940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:27.288225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:27.295340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:27.296684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:27.298371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2d1457c3-e4a0-41e4-8a97-85c5fb9a73ad tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1743 microversion: 2.20 time: 0.259969 Oct 06 04:37:27.298930 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 329/687] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:27 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:28.327140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:28.327748 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:28.336659 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:28.337138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:28.337574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:28.338267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:28.338722 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:28.339305 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:28.470408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:28.479906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:28.481392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:28.482614 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c4a994fd-3aed-4e93-8860-7a78df14480c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1743 microversion: 2.20 time: 0.161455 Oct 06 04:37:28.483200 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 359/688] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:28 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:29.509518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:29.510126 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:29.517774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:29.518260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:29.518689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:29.519416 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:29.519867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:29.520295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:29.664590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:29.673720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:29.675347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:29.676669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3c141001-e427-4b3a-8d70-9dbc86ee030a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1743 microversion: 2.20 time: 0.170825 Oct 06 04:37:29.677230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 330/689] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:29 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:30.702345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:30.703091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:30.710434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:30.711122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:30.711466 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:30.712238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:30.712806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:30.713416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:30.817397 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-eea842ca-0a00-431c-b9f7-b634a9d2181e req-04ab123d-35bc-4421-8f3c-7607c54d18b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c46bbc-e699-4b17-99e5-d6a70df92e2c", "name": "network-vif-plugged", "status": "completed", "tag": "542157e8-aced-4f6a-815d-a118c4b3ca2c"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:30.835769 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-eea842ca-0a00-431c-b9f7-b634a9d2181e req-04ab123d-35bc-4421-8f3c-7607c54d18b1 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:30.836539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-eea842ca-0a00-431c-b9f7-b634a9d2181e req-04ab123d-35bc-4421-8f3c-7607c54d18b1 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:30.837144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-eea842ca-0a00-431c-b9f7-b634a9d2181e req-04ab123d-35bc-4421-8f3c-7607c54d18b1 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:30.850917 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-eea842ca-0a00-431c-b9f7-b634a9d2181e req-04ab123d-35bc-4421-8f3c-7607c54d18b1 service nova] Creating event network-vif-plugged:542157e8-aced-4f6a-815d-a118c4b3ca2c for instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c on hv-cinder-86022 Oct 06 04:37:30.858073 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-eea842ca-0a00-431c-b9f7-b634a9d2181e req-04ab123d-35bc-4421-8f3c-7607c54d18b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045067 Oct 06 04:37:30.859486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 331/690] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:37:30.865083 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:30.877887 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:30.880431 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:30.882267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3033c7a2-e191-4ca0-a2c4-8bb1420811a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1743 microversion: 2.20 time: 0.183811 Oct 06 04:37:30.899006 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 360/691] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:30 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:31.913794 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:31.914480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:31.920790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:31.921275 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:31.921711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:31.923005 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:31.923462 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:31.923887 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:32.088273 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:32.097902 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:32.099731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:32.101039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-212f9bc9-a40d-4264-ad54-0065a8de03b9 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1743 microversion: 2.20 time: 0.191633 Oct 06 04:37:32.101639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 332/692] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:31 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:33.132813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:33.134495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:33.149394 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:33.150093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:33.151268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:33.153195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:33.153850 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:33.154600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:33.714805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:33.729156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:33.736098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:33.738526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f78f4939-09b3-4495-bd71-c0ef1a0705cb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.610046 Oct 06 04:37:33.755446 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 361/693] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:33 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:34.771386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:34.772693 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:34.783565 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:34.784041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:34.784520 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:34.785195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:34.788500 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:34.788981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:35.013479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:35.026997 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:35.034159 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:35.034159 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c80b350b-064d-4ddf-af12-5eb3616f1527 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.264170 Oct 06 04:37:35.046987 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 333/694] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:34 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:36.057570 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:36.062044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:36.069922 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:36.070383 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:36.070840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:36.071664 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:36.077928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:36.079164 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:36.252017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:36.265139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:36.267270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:36.268691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8a6e2bbf-5e11-4258-abb5-7dbfac6f9fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.215214 Oct 06 04:37:36.269777 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 362/695] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:36 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:37:37.313218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:37.320832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:37.338503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:37.341039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:37.341780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:37.344834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:37.350739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:37.351588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:38.043256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:38.056932 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:38.058645 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:38.063098 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5b4767f8-077c-4b1a-a015-d300c04da7a5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.766985 Oct 06 04:37:38.066796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 334/696] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:37 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:39.103302 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:39.104682 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:39.115794 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:39.117472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:39.119049 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:39.120611 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:39.121411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:39.122918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:39.376051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:39.385021 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:39.394456 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:39.396067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-544b2fcb-98c0-4434-9415-faac8678b20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.302196 Oct 06 04:37:39.397248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 363/697] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:39 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:40.424203 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:40.425495 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:40.439696 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:40.440384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:40.442211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:40.443971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:40.444604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:40.446373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:40.785880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:40.795129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:40.801605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:40.802834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c98f22db-3f96-4ccb-b7ae-6384d603ce0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.385128 Oct 06 04:37:40.803437 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 335/698] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:40 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:41.833964 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:41.834636 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:41.841147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:41.841954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:41.842624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:41.844514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:41.845289 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:41.845960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:42.172943 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:42.189905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:42.191890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:42.193456 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6d60b876-9217-4e10-b95f-973ec68d1479 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.363334 Oct 06 04:37:42.208044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 364/699] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:41 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:37:43.223495 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:43.224106 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:43.233180 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=36 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:43.236943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:43.237636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:43.238276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:43.239294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:43.239914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:43.240335 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:43.535508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:43.575340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:43.577234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:43.579379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-676817a8-a35c-40e9-8828-677bf41fe395 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.361645 Oct 06 04:37:43.580681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 336/700] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:43 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:44.612609 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:44.613701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:44.632277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:44.634588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:44.638539 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:44.639668 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:44.640329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:44.641020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:44.970858 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:44.979620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:44.981370 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:44.982798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0d4791b4-6104-4a07-bfb3-3cf527d81bca tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.376480 Oct 06 04:37:45.027133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 365/701] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:44 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:46.009745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:46.010330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:46.017648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:46.018410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:46.019066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:46.019971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:46.020588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:46.021173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:46.228338 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:46.238335 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:46.239813 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:46.241809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-64952531-bea9-4690-a321-83ca34ce6f2e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.235999 Oct 06 04:37:46.242900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 337/702] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:46 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:47.272938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:47.273537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:47.280192 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:47.281931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:47.282377 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:47.283316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:47.283771 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:47.284358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:47.287295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=82 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:47.425503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:47.436779 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:47.439212 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:47.443653 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1c065b60-6cc4-47dc-ac0e-2a48c6613df4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1738 microversion: 2.20 time: 0.174581 Oct 06 04:37:47.444482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 366/703] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:47 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:48.470660 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:48.471299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:48.481240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:48.482654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:48.483589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:48.484866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:48.485681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:48.486412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:48.781287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:48.794250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:48.796091 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:48.799183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b068d8c5-9a64-4a53-8eca-73fa8c31b4a1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1720 microversion: 2.20 time: 0.332983 Oct 06 04:37:48.811986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 338/704] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:48 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1720 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:49.855475 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:49.856103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:49.863957 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:49.864447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:49.864878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:49.865593 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:49.866038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:49.866465 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:50.032955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:50.042300 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:50.044179 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:50.045413 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c2df45b2-248d-420f-a1b9-2c91fb16fd1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1720 microversion: 2.20 time: 0.202751 Oct 06 04:37:50.046551 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 367/705] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:49 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:50.860786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-8557ec44-78e9-4361-85f4-9be2ed1d3b15 req-bbf8ead5-4847-4f86-afd0-2580c17cb3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c46bbc-e699-4b17-99e5-d6a70df92e2c", "name": "network-vif-unplugged", "status": "completed", "tag": "542157e8-aced-4f6a-815d-a118c4b3ca2c"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:50.874197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-8557ec44-78e9-4361-85f4-9be2ed1d3b15 req-bbf8ead5-4847-4f86-afd0-2580c17cb3f1 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:50.879974 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-8557ec44-78e9-4361-85f4-9be2ed1d3b15 req-bbf8ead5-4847-4f86-afd0-2580c17cb3f1 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:50.880698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-8557ec44-78e9-4361-85f4-9be2ed1d3b15 req-bbf8ead5-4847-4f86-afd0-2580c17cb3f1 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:50.910251 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-8557ec44-78e9-4361-85f4-9be2ed1d3b15 req-bbf8ead5-4847-4f86-afd0-2580c17cb3f1 service nova] Creating event network-vif-unplugged:542157e8-aced-4f6a-815d-a118c4b3ca2c for instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c on hv-cinder-86022 Oct 06 04:37:50.918945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-8557ec44-78e9-4361-85f4-9be2ed1d3b15 req-bbf8ead5-4847-4f86-afd0-2580c17cb3f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061100 Oct 06 04:37:50.920725 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 339/706] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:37:51.074061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:51.075632 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:51.084747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=26 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:51.086455 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:51.086917 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:51.087475 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:51.088395 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:51.089049 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:51.089473 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:51.242507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:51.252565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:51.254335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:51.255979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7bae8ff9-b80e-4f2a-92c4-739d3e777f38 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1723 microversion: 2.20 time: 0.185879 Oct 06 04:37:51.257248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 368/707] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:51 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:51.282454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fe75a32-42bc-410a-8b4d-80c24587b719"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:51.286389 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:51.298466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:51.299242 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:51.299861 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:51.300705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:51.301310 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:51.301886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:51.668186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-69206d6f-f305-48d8-b6a5-c55d50953fdd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.390795 Oct 06 04:37:51.669295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 340/708] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Oct 6 04:37:51 2022] POST /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments => generated 188 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:37:51.815617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:51.816199 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:51.825646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:51.826130 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:51.826562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:51.827291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:51.828159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:51.828749 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:51.933973 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127097) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 04:37:52.026605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-233a23b3-9c61-4d44-9c8c-8947609d720e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/action" status: 202 len: 0 microversion: 2.20 time: 0.215628 Oct 06 04:37:52.027579 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 369/709] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Oct 6 04:37:51 2022] POST /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:37:52.035559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:52.036083 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:52.050529 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:52.051051 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:52.051488 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:52.052193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:52.052642 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:52.053060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:52.210396 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:52.226047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:52.230053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:52.231695 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-630fa580-7f57-4b71-871a-246c2d8811ee tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1749 microversion: 2.20 time: 0.200234 Oct 06 04:37:52.234717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 341/710] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:52 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1749 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:37:53.264921 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:53.266413 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:53.273135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:53.274209 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:53.274657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:53.275770 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:53.276231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:53.276655 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:53.351255 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8079d924-3f77-47c7-84b6-65d10ab62316 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Action: 'create', calling method: .version_select at 0x7f0c429c0e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-618934545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVt5s00HZ4GrfTpq5LWivBBhQmJw0rpOzuU75g5lmNA5LD0HlnyzsEQ2mHpkEDZc0sOrPqXuUSUY2psAnfgTsvGZCm0rQeWqphonGlBXC/YbmSRnuv8JerBCkBoYsLuQQ=="}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:53.368330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-8079d924-3f77-47c7-84b6-65d10ab62316 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Getting quotas for project 43ee2f7c65044158a0230e4997d7bdf9. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:37:53.372414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-8079d924-3f77-47c7-84b6-65d10ab62316 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Getting quotas for user ddfa371a39b84f42bba4621ae3a99794 and project 43ee2f7c65044158a0230e4997d7bdf9. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:37:53.396445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8079d924-3f77-47c7-84b6-65d10ab62316 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049076 Oct 06 04:37:53.397059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 342/711] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:37:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:37:53.440511 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:53.449162 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:53.450844 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:53.452037 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a73dfef2-5b7d-4d19-baa9-9417b12f8c0b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1749 microversion: 2.20 time: 0.192974 Oct 06 04:37:53.453130 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 370/712] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:53 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1749 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:37:53.457925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1910614317", "imageRef": "bf2e30b8-ee8b-4c52-aa4c-303a9e85d8ec", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-618934545", "networks": [{"uuid": "3a303baf-b9bc-4406-9e05-dfe13f0dd5fd"}]}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:37:53.510946 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] validate_networks() for [('3a303baf-b9bc-4406-9e05-dfe13f0dd5fd', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:37:53.935100 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:37:53.935521 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:37:53.935992 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:37:53.936401 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:37:53.937408 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:37:53.946252 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:53.946729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:53.947194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:53.947914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:53.948377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:53.948809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:53.966392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Getting quotas for project 43ee2f7c65044158a0230e4997d7bdf9. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:37:53.970516 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Getting quotas for user ddfa371a39b84f42bba4621ae3a99794 and project 43ee2f7c65044158a0230e4997d7bdf9. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:37:53.981672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:37:53.984571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf2e30b8-ee8b-4c52-aa4c-303a9e85d8ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:37:54.041850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-08e61e12-16dd-43dd-aa69-2f39969c3356 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587615 Oct 06 04:37:54.042522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 343/713] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:37:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 04:37:54.053906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9d0c8767-f2c9-41c2-ad12-cb1aad139422 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:54.054520 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-9d0c8767-f2c9-41c2-ad12-cb1aad139422 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:54.114365 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-9d0c8767-f2c9-41c2-ad12-cb1aad139422 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:54.121683 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9d0c8767-f2c9-41c2-ad12-cb1aad139422 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1258 microversion: 2.1 time: 0.071587 Oct 06 04:37:54.122226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 371/714] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:54 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:54.477933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:54.479133 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:54.486690 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:54.487211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:54.487642 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:54.488454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:54.488900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:54.489347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:54.641925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:54.651213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:54.652648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:54.653813 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-09c56354-ea71-4bd8-8f03-182bf3e1c35b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.180090 Oct 06 04:37:54.654367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 344/715] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:54 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:55.144726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:55.145411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:55.153873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:55.154584 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:55.155236 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:55.157765 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:55.158237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:55.158706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:55.226101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:55.235048 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b02b99dd-b61a-4a79-88cb-a1f586fe58b1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1310 microversion: 2.1 time: 0.094723 Oct 06 04:37:55.235875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 372/716] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:55 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:55.681980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:55.682686 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:55.689170 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:55.689950 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:55.690591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:55.691707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:55.692390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:55.693205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:55.883174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:55.893791 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:55.895366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:55.896816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d61ae691-1e2b-4914-ba93-d7f1303e08b8 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.219918 Oct 06 04:37:55.897664 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 345/717] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:55 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:56.268095 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:56.270579 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:56.284088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:56.285312 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:56.285756 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:56.289101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:56.289527 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:56.290635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:56.417159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:56.434102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a0588696-fd15-499a-9b53-803525ef7207 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1316 microversion: 2.1 time: 0.177870 Oct 06 04:37:56.435090 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 373/718] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:56 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:56.922701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:56.923330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:56.939315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:56.945175 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:56.945791 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:56.946687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:56.948010 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:56.954018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:57.140640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:57.143147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:37:57.150806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:57.152265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:57.153409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b0c1252c-4689-493a-a9bf-7b010b8549ff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.235068 Oct 06 04:37:57.153964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 346/719] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:56 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:57.462372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:57.463130 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:57.470220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:57.470707 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:57.471177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:57.471866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:57.472316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:57.472739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:57.620308 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:57.628499 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1d371dfd-4a74-4eb1-9896-0b51821976ac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.169943 Oct 06 04:37:57.629058 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 374/720] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:57 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:58.179058 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:58.179708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:58.190582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:58.191136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:58.191632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:58.192316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:58.192782 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:58.193295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:58.333873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:58.342559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:58.344863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:58.346339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f9aab44f-891c-4c9d-b222-bd4454165cda tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.171854 Oct 06 04:37:58.347047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 347/721] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:58 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:58.651609 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:58.652197 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:58.659475 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:58.659957 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:58.660387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:58.661084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:58.661535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:58.662012 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:58.799042 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:58.806952 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b84366a7-1330-4183-aa23-5d318089b0fe tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.159139 Oct 06 04:37:58.807818 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 375/722] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:58 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:37:59.374510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:59.375166 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:59.381646 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:59.382330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:59.382764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:59.383492 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:59.383945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:59.384369 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:59.522121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:59.530605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:59.532147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:59.533747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-635f1c6f-1ec1-4726-8992-6de9211c0710 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.163152 Oct 06 04:37:59.534302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 348/723] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:37:59 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:37:59.831812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:37:59.832420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:37:59.838710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:59.839221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:59.839648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:59.840332 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:37:59.840786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:37:59.841204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:37:59.971254 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:37:59.979546 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5828a015-a8ae-4f95-a141-b9cd698ee103 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.152303 Oct 06 04:37:59.980122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 376/724] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:37:59 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:00.561266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:00.561836 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:00.568907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:00.569385 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:00.569819 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:00.570504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:00.570996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:00.571471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:00.708704 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:00.717349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:00.718789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:00.720212 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-dbd9affd-3086-4fee-b47b-a7d9f92dc328 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.162999 Oct 06 04:38:00.720710 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 349/725] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:00 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:01.002365 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:01.003005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:01.009352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:01.009839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:01.010268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:01.010985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:01.011432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:01.011860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:01.178869 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:01.187061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e3b3efdf-2e34-44f3-b52f-bd8fb1156ac4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.188531 Oct 06 04:38:01.187629 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 377/726] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:00 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:01.745814 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:01.746433 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:01.752732 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:01.753218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:01.753626 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:01.754306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:01.754749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:01.755203 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:01.898723 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:01.907966 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:01.909618 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:01.910779 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4a921e7b-ad43-4070-93a3-606f1e87a861 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.169107 Oct 06 04:38:01.911373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 350/727] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:01 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:02.213949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:02.214739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:02.229023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:02.229630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:02.230312 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:02.231260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:02.231919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:02.232441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:02.372890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:02.380539 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-470ec8b8-7056-4548-9712-3b3e764b2d92 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.170441 Oct 06 04:38:02.381098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 378/728] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:02 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:02.937703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:02.938318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:02.944679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:02.945154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:02.945584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:02.946264 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:02.946710 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:02.947170 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:03.096365 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:03.109271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:03.111388 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:03.112632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0b84dc44-d683-45bf-9245-5d1c67511fcb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.178746 Oct 06 04:38:03.113401 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 351/729] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:02 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:03.403446 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:03.405031 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:03.412434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:03.413282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:03.413936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:03.415161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:03.415840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:03.416556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:03.546885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:03.555113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d6755841-06f4-49a9-9627-ed7a55105b15 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.155746 Oct 06 04:38:03.555676 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 379/730] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:03 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:04.137688 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:04.138303 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:04.140580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:04.141276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=10 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:04.146993 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:04.147471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:04.147900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:04.148579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:04.149023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:04.149441 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:04.307417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:04.318529 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:04.319993 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:04.321150 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ed6fcbb1-5546-4c69-bdbd-74ed4510d37c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.187379 Oct 06 04:38:04.321707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 352/731] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:04 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:04.581848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:04.582490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:04.584338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:04.589913 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:04.590395 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:04.590861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:04.591586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:04.592044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:04.592470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:04.727934 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:04.736737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2359f2d8-0477-4adb-96da-e993fdc1ff78 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.158794 Oct 06 04:38:04.737319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 380/732] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:04 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:05.347767 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:05.348434 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:05.355108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:05.355590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:05.356020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:05.356710 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:05.357193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:05.357613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:05.498752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:05.508617 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:05.510057 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:05.511269 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-46bd0c05-01ce-4093-8ee0-b3a449b71cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.168278 Oct 06 04:38:05.511829 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 353/733] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:05 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:05.760514 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:05.761052 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:05.768673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:05.769448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:05.769888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:05.770635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:05.771120 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:05.771549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:05.814050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d624c89-df3f-4e41-a66d-3d003d7be521"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:05.816474 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:05.822576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:05.823106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:05.823547 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:05.824259 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:05.824718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:05.825144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:05.934434 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:05.942830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-442813ef-989c-45d3-b39e-559e42c173fb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.186244 Oct 06 04:38:05.943491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 354/734] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:05 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:06.537494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:06.538111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:06.544538 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:06.545024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:06.545469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:06.546187 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:06.546645 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:06.547103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:06.698123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:06.707348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:06.708792 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:06.709980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-579df867-f19c-482b-8373-25c950588029 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.176392 Oct 06 04:38:06.710544 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 355/735] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:06 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:06.965049 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:06.965578 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:06.972369 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:06.972854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:06.973294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:06.973989 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:06.974446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:06.974872 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:07.106618 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:07.121161 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1f56304e-4da3-43e1-9c8c-7882c95cf6af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.159968 Oct 06 04:38:07.121961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 356/736] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:06 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:07.736093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:07.737286 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:07.743464 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:07.744194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:07.744652 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:07.745341 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:07.745794 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:07.746209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:07.894501 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:07.902976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:07.904410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:07.905561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4ae793cc-666e-4b4b-8279-e84238a27c25 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.173709 Oct 06 04:38:07.906123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 357/737] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:07 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:08.144094 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:08.144705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:08.150605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:08.151122 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:08.151559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:08.152244 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:08.152698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:08.153121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:08.280921 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:08.288975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-28cb8213-1dc0-48dc-9d23-be13d7d62b05 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.148900 Oct 06 04:38:08.289534 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 358/738] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:08 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:08.932015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:08.932695 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:08.939136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:08.939622 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:08.940058 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:08.940746 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:08.941198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:08.941623 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:09.072602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:09.081670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:09.083135 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:09.084295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-326e5bc9-e6a1-49b5-b5c1-e26916d5e1e2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.156149 Oct 06 04:38:09.084864 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 359/739] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:08 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:09.312132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:09.312748 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:09.319767 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:09.320262 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:09.320699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:09.321406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:09.321861 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:09.322284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:09.456917 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:09.464387 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-230958b5-bfa8-4068-898b-062f71d52411 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.156235 Oct 06 04:38:09.464950 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 360/740] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:09 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:10.111282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:10.112740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:10.122056 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:10.122551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:10.123005 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:10.123810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:10.124455 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:10.124884 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:10.260751 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:10.269577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:10.271024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:10.272189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2106a302-afa9-43ef-b0a8-e4ee0337b18f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.165030 Oct 06 04:38:10.272756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 361/741] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:10 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:10.489577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:10.490183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:10.496949 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:10.497453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:10.497877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:10.498589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:10.499071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:10.499493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:10.635110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:10.643719 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6f88b9ff-3f97-4997-a3ea-fb280512b293 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.159570 Oct 06 04:38:10.644298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 362/742] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:10 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:11.300520 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:11.301283 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:11.308326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:11.308957 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:11.309499 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:11.310310 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:11.310865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:11.311410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:11.342326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:11.505180 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:11.514196 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:11.515711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:11.517002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5956d0a9-acaa-47c8-8e18-681245db6cf5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.220701 Oct 06 04:38:11.518325 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 363/743] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:11 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:11.680611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-2df1a0d0-48c4-4421-a3ca-b77d8934520d req-040cfe56-61dd-4fb1-a09e-e200180661e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee803bb5-a84c-4e42-a010-76f9cfba5933", "tag": "45ae6e2d-fb0b-43fb-856e-042caa9bfd4d"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:11.709460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2df1a0d0-48c4-4421-a3ca-b77d8934520d req-040cfe56-61dd-4fb1-a09e-e200180661e3 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:11.710070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2df1a0d0-48c4-4421-a3ca-b77d8934520d req-040cfe56-61dd-4fb1-a09e-e200180661e3 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:11.710551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2df1a0d0-48c4-4421-a3ca-b77d8934520d req-040cfe56-61dd-4fb1-a09e-e200180661e3 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:11.728119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-2df1a0d0-48c4-4421-a3ca-b77d8934520d req-040cfe56-61dd-4fb1-a09e-e200180661e3 service nova] Creating event network-changed:45ae6e2d-fb0b-43fb-856e-042caa9bfd4d for instance ee803bb5-a84c-4e42-a010-76f9cfba5933 on hv-cinder-86022 Oct 06 04:38:11.735779 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-2df1a0d0-48c4-4421-a3ca-b77d8934520d req-040cfe56-61dd-4fb1-a09e-e200180661e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133512 Oct 06 04:38:11.736968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 364/744] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:11.742147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:11.742846 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:11.749985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:11.750475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:11.750910 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:11.752333 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:11.752928 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:11.753419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:11.898482 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:11.907518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-90ee00b8-81f2-4893-845e-394eb687e3cb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.169318 Oct 06 04:38:11.908655 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 365/745] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:11 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:12.543901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:12.545277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:12.552735 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:12.553217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:12.553644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:12.554338 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:12.554783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:12.555230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:12.713609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:12.724474 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:12.726367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:12.727667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5c967298-1c04-4f05-87b9-4e556bb0137e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.187721 Oct 06 04:38:12.728228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 366/746] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:12 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:12.932572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:12.933167 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:12.939092 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:12.939572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:12.940001 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:12.940677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:12.941164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:12.941583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:13.084466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:13.092319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9ab7609d-40d0-4ea9-9169-fd2c23656ea8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.163665 Oct 06 04:38:13.093098 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 367/747] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:12 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:13.753925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:13.754741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:13.757419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:13.762389 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:13.762871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:13.763326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:13.764072 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:13.764475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:13.764997 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:13.917758 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:13.927295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:13.929202 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:13.929951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b01451e3-8d39-4b8a-b94b-57196aa13171 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.180558 Oct 06 04:38:13.930521 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 368/748] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:13 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:14.116048 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:14.116657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:14.122838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:14.123379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:14.123841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:14.124532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:14.124987 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:14.125411 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:14.263584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:14.271903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-32343299-24a2-4149-a929-b24e97e78063 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.160254 Oct 06 04:38:14.272700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 369/749] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:14 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:14.956506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:14.957391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:14.964199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:14.964683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:14.965113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:14.965814 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:14.966260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:14.966677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:15.111064 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:15.121774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:15.123270 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:15.124525 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d4ffe8b5-68c5-416c-9834-f91c603f4ab0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.172768 Oct 06 04:38:15.135042 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 370/750] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:14 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:15.296492 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:15.297131 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:15.304655 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:15.305149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:15.305582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:15.306316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:15.306765 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:15.307213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:15.455693 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:15.465112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-16f74ee4-ec00-4f5a-b1ab-391b2b65e8da tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.172793 Oct 06 04:38:15.465850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 371/751] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:15 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:15.820782 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:15.946604 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:16.151377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:16.151975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:16.158437 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:16.158921 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:16.159382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:16.160082 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:16.160542 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:16.160951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:16.295016 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:16.304822 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:16.306355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:16.307657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9fe545cc-8663-4915-9597-21d9ac358548 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.160184 Oct 06 04:38:16.308259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 372/752] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:16 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:16.489239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:16.489841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:16.496391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:16.496904 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:16.497308 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:16.498010 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:16.498461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:16.498879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:16.639824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:16.649019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e640990d-af5f-4aa5-93e7-1305dd19af64 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.163626 Oct 06 04:38:16.649595 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 373/753] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:16 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:17.334250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:17.334945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:17.341602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:17.342098 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:17.342516 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:17.343294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:17.343746 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:17.344156 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:17.488654 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:17.497723 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:17.499268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:17.500609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-daf8073a-25fb-4def-add7-39488d875e94 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.171212 Oct 06 04:38:17.501215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 374/754] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:17 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:17.672521 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:17.673125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:17.679759 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:17.683060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:17.683523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:17.684255 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:17.684714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:17.685137 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:17.830908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:17.839403 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4cd3c029-2e62-4022-a304-54707db3dac8 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.170648 Oct 06 04:38:17.851001 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 375/755] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:17 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:18.527701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:18.528340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:18.534795 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:18.535312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:18.535747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:18.536453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:18.536905 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:18.537330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:18.672917 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:18.682870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:18.684329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:18.685490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-cb55a0c4-537d-41aa-8d48-a28fef9508eb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.162204 Oct 06 04:38:18.686050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 376/756] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:18 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:18.861818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:18.863198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:18.869665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:18.870147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:18.870580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:18.871311 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:18.871764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:18.872192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:19.011769 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:19.020582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4e48aa0f-7d65-405d-97b2-98b55ab85e1f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.162655 Oct 06 04:38:19.021436 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 377/757] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:18 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:19.711401 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:19.712145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:19.718689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:19.719229 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:19.719663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:19.720365 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:19.720818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:19.721243 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:19.858143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:19.868312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:19.870011 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:19.871206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4376086a-ea84-40a2-b21d-4014ae08d217 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.163958 Oct 06 04:38:19.871847 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 378/758] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:19 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:20.044696 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:20.045215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:20.051700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:20.052177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:20.052604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:20.053283 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:20.053728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:20.054145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:20.187586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:20.195726 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f9f65bf5-ff25-44ff-b160-7ee15c97ad48 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.154903 Oct 06 04:38:20.196518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 379/759] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:20 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:20.896818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:20.897507 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:20.903779 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:20.904257 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:20.904687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:20.905371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:20.905817 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:20.906236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:21.040579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:21.042713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:21.050714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:21.052194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:21.053491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-16a8ba53-ee57-430d-87f1-bf297c5511fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.161177 Oct 06 04:38:21.054051 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 380/760] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:20 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:21.219742 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:21.220340 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:21.227015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:21.227562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:21.227925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:21.228606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:21.229053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:21.229472 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:21.359745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:21.367373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-27d47f79-368a-4c76-a248-5ab7e3138d9d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.151638 Oct 06 04:38:21.367958 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 381/761] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:21 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:22.077639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:22.078291 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:22.084809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:22.085288 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:22.085722 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:22.086412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:22.086867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:22.087337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:22.449294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:22.458577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:22.460027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:22.461179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4fbaae1d-acb9-4de7-869d-cef34354fea6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.387445 Oct 06 04:38:22.461746 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 382/762] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:22 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:22.466024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:22.466681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:22.472836 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:22.473264 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:22.473698 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:22.474382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:22.474830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:22.475285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:22.600766 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:22.608283 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d67a881d-4cfb-4332-82e9-74c1ed7287b3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.145605 Oct 06 04:38:22.608852 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 383/763] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:22 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:23.486930 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:23.487656 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:23.494149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:23.494624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:23.495162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:23.495850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:23.496303 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:23.496727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:23.626377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:23.635691 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:23.637120 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:23.638271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9cf4d553-fef6-46b1-ad1e-1d1fd4cdac23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.155296 Oct 06 04:38:23.638831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 384/764] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:23 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:23.643178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:23.644490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:23.649869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:23.650347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:23.650781 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:23.651492 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:23.651972 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:23.652395 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:23.780150 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:23.788028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fa0e2a5e-caf3-49d4-904a-fdca25f06163 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.148247 Oct 06 04:38:23.788602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 385/765] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:23 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:24.004216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cd6e8a77-3737-454f-8098-f62e0ee8eea1 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 18.310232 Oct 06 04:38:24.004977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 381/766] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:38:05 2022] POST /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments => generated 194 bytes in 18312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:24.664558 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:24.665164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:24.671723 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:24.672145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:24.672580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:24.673266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:24.673718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:24.674138 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:24.801209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:24.809678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:24.811139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:24.811863 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:24.812316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8e00c054-a631-49c1-8fc4-434873cd9b62 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.151673 Oct 06 04:38:24.812555 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:24.812867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 386/767] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:24 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:38:24.819297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:24.819774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:24.820204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:24.820892 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:24.821341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:24.821762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:24.947537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:24.955188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8c478f86-7201-430d-8e12-2a8b51d5189f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.147911 Oct 06 04:38:24.955750 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 382/768] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:24 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:25.838185 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:25.838785 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:25.845116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:25.845593 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:25.846025 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:25.846741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:25.847215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:25.847634 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:25.978230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:25.978840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:25.979801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:25.985573 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:25.986053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:25.986706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:25.987685 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:25.988238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:25.988507 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:25.988821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:25.989929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:25.991226 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1779480a-a445-4aa9-b606-cdc7d81c3fed tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.156856 Oct 06 04:38:25.991787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 387/769] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:25 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:26.193940 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:26.201411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6dab9f66-116b-40da-882b-ffc6100762cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.227087 Oct 06 04:38:26.201983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 383/770] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:25 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:27.018406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:27.019079 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:27.025475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:27.025956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:27.026393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:27.027108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:27.027564 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:27.027989 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:27.155818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:27.164947 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:27.166370 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:27.167591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-10ade0df-cccd-4aae-bb8c-ac264a3a5a0d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.153094 Oct 06 04:38:27.168153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 388/771] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:27 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:27.231363 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:27.231984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:27.238390 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:27.238880 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:27.239357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:27.240057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:27.240515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:27.240942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:27.373859 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:27.384447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ee5a4744-62ab-4e90-b05e-e504c747b9f1 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.163440 Oct 06 04:38:27.385027 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 384/772] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:27 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:28.193074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:28.193657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:28.200048 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:28.200523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:28.200983 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:28.201662 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:28.202107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:28.202525 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:28.338042 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:28.346727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:28.349059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:28.350214 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b726de0e-3afa-4455-afb7-f20242b4b27e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.161514 Oct 06 04:38:28.350778 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 389/773] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:28 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:28.409450 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:28.410660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:28.416973 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:28.417459 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:28.417899 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:28.418587 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:28.419068 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:28.419500 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:28.545931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:28.553551 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4813c554-1f73-40ff-b8cf-bb5e1157d942 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.147882 Oct 06 04:38:28.554113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 385/774] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:28 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:29.375764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:29.376362 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:29.383474 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:29.383957 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:29.384388 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:29.385066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:29.385548 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:29.385970 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:29.513604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:29.522178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:29.523636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:29.524777 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b51fbc79-4651-4c22-a7bd-e53a2ab0d351 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.152909 Oct 06 04:38:29.525331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 390/775] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:29 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:29.576000 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:29.576636 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:29.582843 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:29.583456 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:29.583893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:29.584580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:29.585033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:29.585452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:29.711310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:29.719091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2429a700-00d4-4bfb-9c5e-342fbb382f1e tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.146816 Oct 06 04:38:29.719657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 386/776] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:29 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:30.549570 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:30.550173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:30.557036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:30.557509 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:30.557935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:30.558615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:30.559084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:30.559504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:30.689604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:30.698884 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:30.700331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:30.701673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1e8da486-7c4c-474b-bd2b-5d86a3ce9edb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.155997 Oct 06 04:38:30.702238 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 391/777] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:30 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:30.742791 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:30.743429 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:30.750096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:30.750583 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:30.751057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:30.751757 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:30.752215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:30.752646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:30.882853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:30.890779 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-090a7b1d-8f37-47af-bcc0-1c978183221b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.152891 Oct 06 04:38:30.891368 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 387/778] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:30 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:31.726541 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:31.727105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:31.733012 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:31.733490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:31.733919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:31.734598 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:31.735081 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:31.735502 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:31.865937 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:31.874748 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:31.876212 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:31.877373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-16445bac-a087-42b3-a3ec-f5d335384f76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.155143 Oct 06 04:38:31.877935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 392/779] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:31 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:31.913487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:31.914140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:31.920480 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:31.920965 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:31.921398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:31.922094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:31.922549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:31.922990 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:32.053010 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:32.060479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8e9a761a-411d-4cde-aa0b-d338d98cf01a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.151020 Oct 06 04:38:32.061039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 388/780] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:31 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:32.904852 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:32.905476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:32.911833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:32.912305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:32.912736 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:32.913411 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:32.913854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:32.914270 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:33.044374 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:33.054208 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:33.055682 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:33.057062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f2194eca-3c13-4d55-b6fe-524b3b50502c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.156043 Oct 06 04:38:33.057707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 393/781] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:32 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:33.084063 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:33.086031 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:33.093839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:33.094419 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:33.095167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:33.096105 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:33.096891 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:33.097329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:33.236515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:33.244694 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5a8567df-f9d6-4879-a40c-8d7ab83c56cc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.164705 Oct 06 04:38:33.245360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 389/782] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:33 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:33.460837 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-53df6702-ddb2-49ce-8b3f-955ba1a5759b req-8431c181-e6b8-4ee1-a522-75a6b0d83970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee803bb5-a84c-4e42-a010-76f9cfba5933", "name": "network-vif-plugged", "status": "completed", "tag": "45ae6e2d-fb0b-43fb-856e-042caa9bfd4d"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:33.479370 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-53df6702-ddb2-49ce-8b3f-955ba1a5759b req-8431c181-e6b8-4ee1-a522-75a6b0d83970 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:33.479853 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-53df6702-ddb2-49ce-8b3f-955ba1a5759b req-8431c181-e6b8-4ee1-a522-75a6b0d83970 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:33.480284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-53df6702-ddb2-49ce-8b3f-955ba1a5759b req-8431c181-e6b8-4ee1-a522-75a6b0d83970 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:33.493387 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-53df6702-ddb2-49ce-8b3f-955ba1a5759b req-8431c181-e6b8-4ee1-a522-75a6b0d83970 service nova] Creating event network-vif-plugged:45ae6e2d-fb0b-43fb-856e-042caa9bfd4d for instance ee803bb5-a84c-4e42-a010-76f9cfba5933 on hv-cinder-86022 Oct 06 04:38:33.499532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-53df6702-ddb2-49ce-8b3f-955ba1a5759b req-8431c181-e6b8-4ee1-a522-75a6b0d83970 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097740 Oct 06 04:38:33.500476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 394/783] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:34.083269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:34.084265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:34.090494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:34.091103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:34.091620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:34.092423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:34.092875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:34.093298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:34.223392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:34.232515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:34.233939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:34.235128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ad8c7492-1667-4107-a227-54480a5a8609 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.155799 Oct 06 04:38:34.235683 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 390/784] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:34 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:34.268747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:34.269476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:34.276337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:34.276821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:34.277255 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:34.277953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:34.278407 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:34.278829 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:34.411923 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:34.419472 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ab7fc068-4358-4955-b184-02570e6f55d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1358 microversion: 2.1 time: 0.155371 Oct 06 04:38:34.420038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 395/785] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:34 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:34.717906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:34.720237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:34.726838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:34.727360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:34.727797 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:34.728486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:34.728949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:34.729374 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:34.752087 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lazy-loading 'flavor' on Instance uuid a48503bd-a381-4011-8f5d-3a4c45eb8e97 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:38:34.871286 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ff047cb0-e2f0-4c50-8527-b897b5284509 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/action" status: 200 len: 32 microversion: 2.1 time: 0.157202 Oct 06 04:38:34.871886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 391/786] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:38:34 2022] POST /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:38:34.881301 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:34.881851 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:34.887815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:34.888314 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:34.888733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:34.889426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:34.889871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:34.890295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.019173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:35.028116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d1bdb523-d9e9-42a4-b4f8-658fde7f9184 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.150672 Oct 06 04:38:35.028696 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 396/787] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:34 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:35.262528 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:35.263260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:35.269384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.269868 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.270306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.271053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.271502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.271932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.406093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:35.417989 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:35.419634 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:35.420934 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b9bd867f-1914-4762-a861-5b4c1ac03a07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.163154 Oct 06 04:38:35.434582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 392/788] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:35 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:35.444622 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:35.445789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:35.452660 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.453160 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.453842 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.454763 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.455305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.455728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.515539 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-fc015ed7-f19d-43f0-a5b3-faaf44a60cc7 req-2c4743e2-c5a4-4a72-bb45-8032f868b9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c46bbc-e699-4b17-99e5-d6a70df92e2c", "name": "network-vif-plugged", "status": "completed", "tag": "542157e8-aced-4f6a-815d-a118c4b3ca2c"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:35.525126 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-fc015ed7-f19d-43f0-a5b3-faaf44a60cc7 req-2c4743e2-c5a4-4a72-bb45-8032f868b9ad service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.525738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-fc015ed7-f19d-43f0-a5b3-faaf44a60cc7 req-2c4743e2-c5a4-4a72-bb45-8032f868b9ad service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.526241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-fc015ed7-f19d-43f0-a5b3-faaf44a60cc7 req-2c4743e2-c5a4-4a72-bb45-8032f868b9ad service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.538422 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-fc015ed7-f19d-43f0-a5b3-faaf44a60cc7 req-2c4743e2-c5a4-4a72-bb45-8032f868b9ad service nova] Creating event network-vif-plugged:542157e8-aced-4f6a-815d-a118c4b3ca2c for instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c on hv-cinder-86022 Oct 06 04:38:35.545155 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-fc015ed7-f19d-43f0-a5b3-faaf44a60cc7 req-2c4743e2-c5a4-4a72-bb45-8032f868b9ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033073 Oct 06 04:38:35.546157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 393/789] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:38:35.606673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:35.615038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-90629933-aadb-4a60-ad00-e86b2c5f5b79 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1548 microversion: 2.1 time: 0.175294 Oct 06 04:38:35.615571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 397/790] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:35 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:35.637458 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:35.638168 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:35.644146 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.644634 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.645066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.645757 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.646217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.646640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.772875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:35.780601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3f6c0b09-6021-436f-afbd-042092b69bac tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1548 microversion: 2.1 time: 0.147236 Oct 06 04:38:35.781160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 394/791] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:35 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:35.803320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:35.808169 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:35.808919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Searching by: {'deleted': False, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9'} {{(pid=127098) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 04:38:35.815393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.815870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.816319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.817017 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:35.817520 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:35.817942 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:35.867015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:35.909333 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.multi_cell_list [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127098) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 04:38:36.052833 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:36.053971 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:36.060849 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:36.061448 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:36.062848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:36.062848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:36.063566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:36.064007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:36.159660 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-51700975-d217-4935-a720-522b0f1e073d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.360703 Oct 06 04:38:36.160250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 398/792] 10.222.0.33 () {58 vars in 1125 bytes} [Thu Oct 6 04:38:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:36.171967 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:36.172565 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:36.178355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:36.178834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:36.179289 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:36.179977 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:36.180423 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:36.180841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:36.208894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:36.212476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:36.218152 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-650d2470-1aaa-44ee-b689-1c26964369e3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.170004 Oct 06 04:38:36.218736 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 395/793] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:36 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:36.309090 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:36.316790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5f45ee20-dc16-4429-a0e3-1ceadef08441 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1548 microversion: 2.1 time: 0.148467 Oct 06 04:38:36.317354 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 399/794] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:36 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:36.453970 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:36.455959 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:36.469796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:36.471992 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:36.472440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:36.473158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:36.474137 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:36.474562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:36.683276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:36.697131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:36.698696 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:36.699755 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1b4bf717-f465-4a11-930c-6aa546c7181c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.252220 Oct 06 04:38:36.710311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 396/795] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:36 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:37.242313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:37.242941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:37.249567 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:37.250044 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:37.250476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:37.251200 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:37.251650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:37.252068 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:37.380264 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:37.388501 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-60663fa4-4211-4492-b099-351d171cae82 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.150735 Oct 06 04:38:37.389069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 400/796] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:37 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:37.724467 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:37.725096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:37.732687 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:37.733176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:37.733606 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:37.734306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:37.734766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:37.735200 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:37.867807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:37.876677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:37.878104 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:37.879324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1456ff5a-248e-4446-96df-2b93d80b7076 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.158766 Oct 06 04:38:37.880399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 397/797] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:37 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:37.946487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30fb6b08-8040-46c8-8e80-07bd4ca93b49"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:37.948929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:37.954853 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:37.955379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:37.955813 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:37.956500 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:37.956954 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:37.957377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:38.247787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e0b44f8d-f6a6-4ff5-bf43-84470d169920 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "POST /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305163 Oct 06 04:38:38.248752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 401/798] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:38:37 2022] POST /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:38.345301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:38.345790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:38.352168 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:38.352653 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:38.353084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:38.353782 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:38.354259 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:38.354869 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:38.414245 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:38.415047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:38.421174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:38.421748 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:38.422176 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:38.423184 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:38.423711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:38.424177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:38.437434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lazy-loading 'services' on Instance uuid dc52256a-9199-4650-94d2-898dc19ce71d {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:38:38.531116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-dbc41255-d104-47fe-8f80-6d70bc0608f9 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/os-volume_attachments/a59e57bd-d6e7-4dea-8e0b-df7fb22eb79d" status: 202 len: 0 microversion: 2.1 time: 0.297056 Oct 06 04:38:38.531776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 398/799] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:38:38 2022] DELETE /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/os-volume_attachments/a59e57bd-d6e7-4dea-8e0b-df7fb22eb79d => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 04:38:38.569595 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:38.578445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-bb2a1cdc-20bb-42ed-9629-84af88f61294 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.169767 Oct 06 04:38:38.579090 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 402/800] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:38 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:38.905603 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:38.906296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:38.912950 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:38.913430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:38.913861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:38.914549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:38.915025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:38.915450 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:39.047703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:39.056993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:39.058426 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:39.059621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8f0562c8-4681-482b-9fe2-76b882c3ea60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1807 microversion: 2.20 time: 0.158676 Oct 06 04:38:39.060173 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 399/801] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:38 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:39.602659 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:39.603378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:39.609895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:39.610498 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:39.611384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:39.611785 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:39.612306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:39.612797 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:39.742575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:39.752119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a4d1885d-7c36-45a1-9261-0297d62885d9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.154323 Oct 06 04:38:39.752705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 403/802] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:39 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:40.084767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:40.085408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:40.091745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:40.092225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:40.092688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:40.093385 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:40.093840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:40.094268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:40.220682 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:40.230570 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:40.232041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:40.233208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-efe7b154-942d-46b4-afc5-b0c845a58e76 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1794 microversion: 2.20 time: 0.152335 Oct 06 04:38:40.233777 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 400/803] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:38:40 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:38:40.776408 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:40.777031 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:40.783371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:40.783850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:40.784279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:40.784961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:40.785410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:40.785825 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:40.918809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:40.926927 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-34870992-3b90-4b45-91bc-9b09f472294d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.154460 Oct 06 04:38:40.927504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 404/804] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:40 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:41.949923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:41.950531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:41.957060 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:41.957544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:41.957981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:41.958682 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:41.959666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:41.960095 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:42.086338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:42.094463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5b669625-163e-43d8-b9a2-8f57a04abe4a tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.148343 Oct 06 04:38:42.095046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 401/805] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:41 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:43.119264 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:43.119935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:43.126249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:43.126727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:43.127198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:43.127884 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:43.128332 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:43.128741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:43.257555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:43.266036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c547deb6-f197-45c0-bada-539e092cb32d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.151414 Oct 06 04:38:43.266619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 405/806] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:43 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:44.293848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:44.294880 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:44.304852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.305329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.305759 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.306450 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.306902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.307352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.441260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:44.450440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-923ed503-f088-45cb-88ed-68b6d5b298bb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.163317 Oct 06 04:38:44.451041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 402/807] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:44 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:44.522503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:44.523038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:44.524963 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=76 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:44.530219 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.530709 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.531178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.531883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.532343 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.532770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.557236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-06284e11-2fee-48dc-b966-ae0318f18586 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2/ips" status: 200 len: 148 microversion: 2.1 time: 0.140038 Oct 06 04:38:44.557786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 406/808] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:38:44 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2/ips => generated 148 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:44.569786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bce29fb-8a7f-4393-83d6-3ed77db53854"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:44.572278 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:44.578151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.578638 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.579104 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.579807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.580263 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.580686 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.660208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Invalid volume: volume 0bce29fb-8a7f-4393-83d6-3ed77db53854 is already attached to instances: ba369ba5-73dc-42d2-a375-b15b0e42188c Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: POST /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2/os-volume_attachments HTTP/1.1 Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 74 Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:38:44.662414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {"volumeAttachment": {"volumeId": "0bce29fb-8a7f-4393-83d6-3ed77db53854"}} Oct 06 04:38:44.664354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Invalid volume: volume 0bce29fb-8a7f-4393-83d6-3ed77db53854 is already attached to instances: ba369ba5-73dc-42d2-a375-b15b0e42188c Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'server_id': 'b0802344-0cf0-48a1-b4cc-b2495c860ac2', 'body': {'volumeAttachment': {'volumeId': '0bce29fb-8a7f-4393-83d6-3ed77db53854'}}} Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0bce29fb-8a7f-4393-83d6-3ed77db53854 is already attached to instances: ba369ba5-73dc-42d2-a375-b15b0e42188c Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:44.665204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0bce29fb-8a7f-4393-83d6-3ed77db53854 is already attached to instances: ba369ba5-73dc-42d2-a375-b15b0e42188c Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:44.666443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:38:44.669078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:38:44.669078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:38:44.669078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:38:44.669078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0bce29fb-8a7f-4393-83d6-3ed77db53854 is already attached to instances: ba369ba5-73dc-42d2-a375-b15b0e42188c Oct 06 04:38:44.669078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:44.669078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 400 to user: Invalid volume: volume 0bce29fb-8a7f-4393-83d6-3ed77db53854 is already attached to instances: ba369ba5-73dc-42d2-a375-b15b0e42188c {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:38:44.669078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b566268f-2473-4ec2-8156-af181eb62d0a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098522 Oct 06 04:38:44.669078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 403/809] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:38:44 2022] POST /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:38:44.673584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:44.674109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:44.680802 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.681286 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.681713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.682391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.682838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.683279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.707835 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:38:44.781665 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-69193ea6-b9ef-46b5-9a68-96355add9f70 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 204 len: 0 microversion: 2.1 time: 0.111562 Oct 06 04:38:44.782135 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 407/810] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:38:44 2022] DELETE /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:38:44.790713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:44.791358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:44.797129 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.797600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.798024 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.798707 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:44.799179 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:44.799602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:44.927003 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:44.935322 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c7adaede-b983-473a-8f31-e8d8ffb4c690 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1681 microversion: 2.1 time: 0.148877 Oct 06 04:38:44.935892 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 404/811] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:44 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:45.473703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:45.474359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:45.480938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:45.481419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:45.481855 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:45.482546 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:45.483020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:45.483452 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:45.610073 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:45.619663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4faa0747-c97c-4274-832c-f473463cdf4d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.150229 Oct 06 04:38:45.620237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 408/812] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:45 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:45.958440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:45.959902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:45.962324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=47 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:45.967719 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:45.968198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:45.968628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:45.969319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:45.969768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:45.970188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:46.100279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:46.107810 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-153f2470-90e9-4c98-b5a1-078796ac8227 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1681 microversion: 2.1 time: 0.153170 Oct 06 04:38:46.108366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 405/813] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:45 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:46.643798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:46.644406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:46.646414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:46.652612 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:46.653098 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:46.653531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:46.654218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:46.654670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:46.655130 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:46.784977 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:46.793643 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f6fdbd5a-a429-4847-811d-88a7d9567c3b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.153788 Oct 06 04:38:46.794212 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 409/814] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:46 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:47.131127 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:47.131737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:47.138067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:47.138549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:47.139021 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:47.139721 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:47.140204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:47.140631 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:47.268678 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:47.276991 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6017a072-8bf8-42ab-b77a-dd034a169099 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1681 microversion: 2.1 time: 0.149798 Oct 06 04:38:47.277556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 406/815] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:47 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:47.817887 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:47.819334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:47.825853 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:47.826339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:47.826771 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:47.827506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:47.827961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:47.828407 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:47.956472 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:47.962502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:47.963236 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:47.966555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-abc5ab9f-80ce-4546-bd93-c63dae8d27bc tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.153365 Oct 06 04:38:47.967354 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 410/816] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:47 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:47.970497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:47.970497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:47.970729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:47.971503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:47.972666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:47.973170 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:48.301090 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:48.301708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:48.308959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:48.309454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:48.309896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:48.310611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:48.311096 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:48.311527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:48.448761 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:48.456406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:48.459954 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-67e6ceeb-826a-4e51-9fe7-7a619ff642b4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1681 microversion: 2.1 time: 0.162324 Oct 06 04:38:48.461015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 411/817] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:48 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:48.461254 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:48.472503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-300ed46c-c714-4f3a-a45f-a01f2864320f tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1594 microversion: 2.1 time: 0.513984 Oct 06 04:38:48.487437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 407/818] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:47 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1594 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:48.994017 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:48.995354 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:49.003552 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.004041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.004666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.005749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.006433 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.007159 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.193982 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-82c4eb49-912b-45eb-98bc-d65b33d495f3 req-3d61b3d4-fa77-4cb8-a193-5eb26cf8192f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0802344-0cf0-48a1-b4cc-b2495c860ac2", "name": "network-vif-deleted", "tag": "9c5e0f8b-c1b2-458f-a4b9-3a77bbe709f2"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:49.205404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-82c4eb49-912b-45eb-98bc-d65b33d495f3 req-3d61b3d4-fa77-4cb8-a193-5eb26cf8192f service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.205796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-82c4eb49-912b-45eb-98bc-d65b33d495f3 req-3d61b3d4-fa77-4cb8-a193-5eb26cf8192f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.206404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-82c4eb49-912b-45eb-98bc-d65b33d495f3 req-3d61b3d4-fa77-4cb8-a193-5eb26cf8192f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.221093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-82c4eb49-912b-45eb-98bc-d65b33d495f3 req-3d61b3d4-fa77-4cb8-a193-5eb26cf8192f service nova] Creating event network-vif-deleted:9c5e0f8b-c1b2-458f-a4b9-3a77bbe709f2 for instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 on hv-cinder-86022 Oct 06 04:38:49.231592 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-82c4eb49-912b-45eb-98bc-d65b33d495f3 req-3d61b3d4-fa77-4cb8-a193-5eb26cf8192f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041389 Oct 06 04:38:49.237782 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 408/819] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:38:49.244789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1ce71660-5b06-4e21-ad3f-7650082f77b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:49.252218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce71660-5b06-4e21-ad3f-7650082f77b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.253494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce71660-5b06-4e21-ad3f-7650082f77b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.254190 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce71660-5b06-4e21-ad3f-7650082f77b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.277662 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:49.288209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0e2bd89f-cb6c-4956-8644-784bcd862f3d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.299523 Oct 06 04:38:49.294615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1ce71660-5b06-4e21-ad3f-7650082f77b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Going to try to stop instance {{(pid=127097) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 04:38:49.303726 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 412/820] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:48 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:49.367844 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1ce71660-5b06-4e21-ad3f-7650082f77b0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/action" status: 202 len: 0 microversion: 2.1 time: 0.127248 Oct 06 04:38:49.368494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 409/821] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:38:49 2022] POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:38:49.380653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:49.386994 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:49.394648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.395507 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.396724 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.397701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.398386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.399065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.485980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:49.487666 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:49.495978 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.496768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.497692 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.498617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.499391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.500043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.558279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:49.568101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:49.568941 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:49.569608 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'fault' on Instance uuid b0802344-0cf0-48a1-b4cc-b2495c860ac2 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:38:49.623458 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:49.636626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f19b9c44-1a05-48d7-8fa3-0a39c9a1ff5b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 200 len: 1332 microversion: 2.1 time: 0.155336 Oct 06 04:38:49.637828 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 410/822] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:49 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 1332 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:49.684052 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:49.699164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9dfc7946-6781-4a5c-9c0b-22958b70d739 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.318301 Oct 06 04:38:49.700632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 413/823] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:49 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:50.312878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:50.313792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:50.326691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:50.327535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:50.328243 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:50.329066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:50.336857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:50.337558 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:50.342948 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:50.509198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:50.519574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-869f7c02-74a3-4c4b-b546-c9b1df5b07ce tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.210397 Oct 06 04:38:50.523439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 411/824] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:50 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:50.664127 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:50.664583 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:50.679785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:50.680307 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:50.687426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-1a9da391-da8d-484b-9323-2f81d001236d req-7dfaf338-33fe-4655-927c-a15fed5dd937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee803bb5-a84c-4e42-a010-76f9cfba5933", "tag": "45ae6e2d-fb0b-43fb-856e-042caa9bfd4d"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:50.696248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:50.697099 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:50.697654 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:50.698151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:50.703475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1a9da391-da8d-484b-9323-2f81d001236d req-7dfaf338-33fe-4655-927c-a15fed5dd937 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:50.707462 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1a9da391-da8d-484b-9323-2f81d001236d req-7dfaf338-33fe-4655-927c-a15fed5dd937 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:50.708071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-1a9da391-da8d-484b-9323-2f81d001236d req-7dfaf338-33fe-4655-927c-a15fed5dd937 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:50.727501 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 HTTP/1.1 Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:38:50.729745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:38:50.731189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'b0802344-0cf0-48a1-b4cc-b2495c860ac2'} Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:38:50.731955 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:38:50.733186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:50.734304 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-1a9da391-da8d-484b-9323-2f81d001236d req-7dfaf338-33fe-4655-927c-a15fed5dd937 service nova] Creating event network-changed:45ae6e2d-fb0b-43fb-856e-042caa9bfd4d for instance ee803bb5-a84c-4e42-a010-76f9cfba5933 on hv-cinder-86022 Oct 06 04:38:50.735973 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:38:50.736929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-20466641-ce05-47e3-b3ab-ce3baa9fc1ed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 404 len: 111 microversion: 2.1 time: 0.080100 Oct 06 04:38:50.737503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 412/825] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:50 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:38:50.743003 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-1a9da391-da8d-484b-9323-2f81d001236d req-7dfaf338-33fe-4655-927c-a15fed5dd937 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125560 Oct 06 04:38:50.743604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 414/826] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:50.746472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:50.747138 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:50.754036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-569d79da-d4aa-4989-9490-b0a1108aacc2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '.version_select at 0x7f0c429f1e50>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:50.763778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:50.765034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:50.765837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:50.766900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:50.767805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:50.769291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:50.778177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-569d79da-d4aa-4989-9490-b0a1108aacc2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469105873" status: 202 len: 0 microversion: 2.1 time: 0.033096 Oct 06 04:38:50.779084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 415/827] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Oct 6 04:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469105873 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:38:51.186694 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:51.195003 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c7eaf8ba-8839-4504-a78d-1e5e3d60f7e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.456458 Oct 06 04:38:51.199291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 413/828] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:50 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:51.548774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:51.549383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:51.564651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:51.565376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:51.566018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:51.566920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:51.569530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:51.570553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.112434 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:52.121241 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fba4f022-3af7-49da-bbf3-269784eb777b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.577034 Oct 06 04:38:52.122761 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 416/829] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:51 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:52.221242 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:52.226783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:52.227519 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:52.229441 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:52.237158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.239317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.240208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.241135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.241781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.242370 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.245323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.246630 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.247420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.250071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.250604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.251199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.338455 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'services' on Instance uuid ba369ba5-73dc-42d2-a375-b15b0e42188c {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:38:52.420324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9d6dc49f-ec66-49d3-9e50-715dfc5f56f3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments/0bce29fb-8a7f-4393-83d6-3ed77db53854" status: 202 len: 0 microversion: 2.1 time: 0.203454 Oct 06 04:38:52.424314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 414/830] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:38:52 2022] DELETE /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments/0bce29fb-8a7f-4393-83d6-3ed77db53854 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:38:52.430466 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:52.433751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:52.450041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.450722 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.451368 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.452076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.452526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.453009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.469838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:52.478197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8673fbc2-2a20-446e-9da7-3cc1fbbdfa2e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.255877 Oct 06 04:38:52.478876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 417/831] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:52 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:52.483897 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-222853315"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:52.484731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:52.485266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-75f96434-cab6-4110-875c-a6c293a03a8d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059471 Oct 06 04:38:52.491017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 415/832] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:38:52 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:52.492355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.492961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.493497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.494579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.495195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.495694 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.625588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.network.security_group_api [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Adding security group 7834e0cd-d634-4aca-be75-3780d2f38a10 to port 45ae6e2d-fb0b-43fb-856e-042caa9bfd4d Oct 06 04:38:52.932300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c0f5bd28-b527-4332-9731-4b0487b8ec95 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "POST /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/action" status: 202 len: 0 microversion: 2.1 time: 0.452259 Oct 06 04:38:52.933024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 418/833] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:38:52 2022] POST /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:38:52.941089 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:52.941802 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:52.942149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-ce6c69bf-1f20-4e9d-81b0-546d3cf080c4 req-c8f58ef5-1f80-4e66-8243-e8be9ed14b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee803bb5-a84c-4e42-a010-76f9cfba5933", "tag": "45ae6e2d-fb0b-43fb-856e-042caa9bfd4d"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:52.948392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.948981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.949517 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.950300 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.950829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.951357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.951795 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ce6c69bf-1f20-4e9d-81b0-546d3cf080c4 req-c8f58ef5-1f80-4e66-8243-e8be9ed14b39 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:52.952278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ce6c69bf-1f20-4e9d-81b0-546d3cf080c4 req-c8f58ef5-1f80-4e66-8243-e8be9ed14b39 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:52.952704 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ce6c69bf-1f20-4e9d-81b0-546d3cf080c4 req-c8f58ef5-1f80-4e66-8243-e8be9ed14b39 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:52.978118 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-ce6c69bf-1f20-4e9d-81b0-546d3cf080c4 req-c8f58ef5-1f80-4e66-8243-e8be9ed14b39 service nova] Creating event network-changed:45ae6e2d-fb0b-43fb-856e-042caa9bfd4d for instance ee803bb5-a84c-4e42-a010-76f9cfba5933 on hv-cinder-86022 Oct 06 04:38:53.002764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-ce6c69bf-1f20-4e9d-81b0-546d3cf080c4 req-c8f58ef5-1f80-4e66-8243-e8be9ed14b39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063388 Oct 06 04:38:53.004035 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 419/834] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:38:53.120531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:53.129249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d3b07561-4a90-4931-9aae-9f96112289af tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1759 microversion: 2.1 time: 0.192080 Oct 06 04:38:53.129816 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 416/835] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:52 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:53.152419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:53.153036 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:53.159392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:53.159881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:53.160315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:53.161009 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:53.161666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:53.162668 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:53.303414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:53.316254 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-19153b23-ccab-4e22-bbc7-9836fccecd20 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.170743 Oct 06 04:38:53.316976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 420/836] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:53 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:53.498262 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:53.500853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:53.504703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:53.504981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:53.507310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:53.507803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:53.508241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:53.508938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:53.509393 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:53.509813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:53.512255 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:53.512772 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:53.513386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:53.513896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:53.514346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:53.514768 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:53.540153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ffa99c46-5ede-4be2-a65b-df0a89ec245b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046251 Oct 06 04:38:53.540724 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 417/837] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:38:53 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:53.658817 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:53.667344 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-742d9943-949c-4ef8-a878-78eff94bcb91 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.166745 Oct 06 04:38:53.667906 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 421/838] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:53 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:54.343314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:54.343923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:54.350632 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:54.351147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:54.351582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:54.352268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:54.352720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:54.353139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:54.480416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:54.488485 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f57f7bf4-4fa9-4930-8484-153baff5339b tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.149125 Oct 06 04:38:54.489039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 418/839] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:54 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:54.551493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:54.554307 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:54.560290 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:54.560779 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:54.561224 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:54.561911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:54.562366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:54.562791 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:54.591839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-98e6cbb5-c000-4ca0-b318-5f999863b91e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Oct 06 04:38:54.592388 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 422/840] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:38:54 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:54.690720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:54.691291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:54.697894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:54.698376 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:54.698815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:54.699542 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:54.699998 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:54.700427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:54.849856 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:54.858290 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-aa8e56a7-98cd-415d-b4a3-9bdde67f9465 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.171362 Oct 06 04:38:54.859088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 419/841] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:54 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:55.512945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:55.513542 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:55.520078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.520547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.521026 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.521656 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.522105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.522523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.605531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:55.613468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:55.620712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.621203 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.622009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.622717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.623295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.623712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.656052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8f63eded-0a2e-4cc0-a228-0e58ee4e8bf9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055559 Oct 06 04:38:55.656809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 420/842] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:38:55 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 04:38:55.667095 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:55.676466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fd46be76-5bf6-4409-8e90-9eee187d3f0c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.167372 Oct 06 04:38:55.677858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 423/843] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:55 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:55.721683 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:55.722201 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:55.728721 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.729215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.729657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.730352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.730810 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.731276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.756934 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:38:55.831034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b3527f83-6422-4500-b4da-b43410c29a6f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 204 len: 0 microversion: 2.1 time: 0.112960 Oct 06 04:38:55.831607 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 421/844] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:38:55 2022] DELETE /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:38:55.840236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:55.840880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:55.846658 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.847181 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.847609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.848292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.848743 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.849257 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.882549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:55.883219 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:55.889695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.890090 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.890775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.891625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:55.892115 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:55.892539 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:55.988518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:55.997797 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8cdbd153-3ac4-4b75-893a-da819568188a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1677 microversion: 2.1 time: 0.161332 Oct 06 04:38:55.998497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 424/845] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:55 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:56.027162 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:56.035331 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1ebd8d66-10e7-4c67-842d-6462774395eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.157316 Oct 06 04:38:56.035889 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 422/846] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:55 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:56.701647 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:56.702281 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:56.708934 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:56.709416 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:56.709850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:56.710548 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:56.711029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:56.711476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:56.860151 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:56.860151 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b2a5f22f-b067-484e-b14c-de7685c3b072 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1736 microversion: 2.1 time: 0.161494 Oct 06 04:38:56.860151 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 425/847] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:56 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:57.020842 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:57.021661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:57.028162 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:57.028645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:57.029079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:57.029798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:57.030249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:57.030670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:57.058650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:57.059283 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:57.065346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:57.065826 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:57.066256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:57.067029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:57.068858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:57.069606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:57.158284 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:57.166420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4a34090c-68b9-4cea-a3f2-206efe86c7fa tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1677 microversion: 2.1 time: 0.149414 Oct 06 04:38:57.167005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 423/848] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:57 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:57.202477 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:57.210865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-edecd86a-d493-4e11-8684-871d9eba6ebd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.156080 Oct 06 04:38:57.211460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 426/849] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:57 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:57.883929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:57.884566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:57.890490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:57.890997 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:57.891437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:57.892134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:57.892590 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:57.893016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.137217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:58.145398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d4c2aa44-cdc5-44c2-b74b-1cedc9455bb5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1716 microversion: 2.1 time: 0.266042 Oct 06 04:38:58.146151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 424/850] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:57 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1716 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:58.189648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:58.190499 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:58.196788 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.197343 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.197845 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.198606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.199190 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.199680 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.207726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:58.208281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:58.216486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.217655 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.218103 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.218817 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.219306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.219771 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.324408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] HTTP exception thrown: Cannot 'detach_volume' instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 while it is in vm_state rescued Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Request method failure captured: Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: DELETE /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments/8d624c89-df3f-4e41-a66d-3d003d7be521 HTTP/1.1 Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpdmJ34Bmk4FmKO5HlGen5bIAzhZqAQylenpJ7_85ZNW-tfMBrtX5dNifLzg9qKz4HDOyxWOxuVA4Tc996oHqqYYeK8DZho_hK92ett81rJJ3pmHidzYBDzAXuAqnUY0__1XlKsU871-sBzdrj8JiETRmBx_OUIVSIuhEghLwqhEq0 Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:38:58.326020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: a58cd041c02d46dcb8acf6adb11ee9de Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:38:58.327400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Cannot 'detach_volume' instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 while it is in vm_state rescued Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'server_id': 'a48503bd-a381-4011-8f5d-3a4c45eb8e97', 'id': '8d624c89-df3f-4e41-a66d-3d003d7be521'} Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:38:58.328091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 while it is in vm_state rescued Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 while it is in vm_state rescued Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:38:58.329895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Returning 409 to user: Cannot 'detach_volume' instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 while it is in vm_state rescued {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:38:58.330909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-969be6cf-d4fc-41c2-9920-c646ad10968d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments/8d624c89-df3f-4e41-a66d-3d003d7be521" status: 409 len: 152 microversion: 2.1 time: 0.123731 Oct 06 04:38:58.330909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 425/851] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:38:58 2022] DELETE /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments/8d624c89-df3f-4e41-a66d-3d003d7be521 => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 04:38:58.334673 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:58.334892 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:58.340638 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.341119 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.341550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.342245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.342695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.343153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.347418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:58.351610 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:58.359869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9e1268f9-0077-4797-ae6e-bcda3edb6f19 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1677 microversion: 2.1 time: 0.174060 Oct 06 04:38:58.360452 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 427/852] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:58 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:58.375428 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:58.376172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:58.382857 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.383370 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.383807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.384536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.385041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.385412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.455464 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-75c7d69c-c2cb-47bb-be09-3f4753723244 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "POST /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/action" status: 202 len: 0 microversion: 2.1 time: 0.086301 Oct 06 04:38:58.459754 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 428/853] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:38:58 2022] POST /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:38:58.466186 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:58.466892 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:58.473382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.473936 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.474383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.475145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.475632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.476063 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.568961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:58.577576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bb8ffd05-2810-40da-8e18-811fb3a7afbb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.247557 Oct 06 04:38:58.578494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 426/854] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:58 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:58.723621 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:58.732132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a8151c69-59d1-4e4d-9704-c7c34b6ac4f9 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1724 microversion: 2.1 time: 0.271051 Oct 06 04:38:58.732991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 429/855] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:58 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:38:58.929013 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-95097a58-a846-4108-b703-662bd374e371 req-be827493-0d59-4bd3-99d5-2faa9a5da39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba369ba5-73dc-42d2-a375-b15b0e42188c", "name": "network-vif-deleted", "tag": "6388b760-70f1-47b6-a577-dd35569e080b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:38:58.938664 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-95097a58-a846-4108-b703-662bd374e371 req-be827493-0d59-4bd3-99d5-2faa9a5da39e service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:58.939240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-95097a58-a846-4108-b703-662bd374e371 req-be827493-0d59-4bd3-99d5-2faa9a5da39e service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:58.939708 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-95097a58-a846-4108-b703-662bd374e371 req-be827493-0d59-4bd3-99d5-2faa9a5da39e service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:58.954133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-95097a58-a846-4108-b703-662bd374e371 req-be827493-0d59-4bd3-99d5-2faa9a5da39e service nova] Creating event network-vif-deleted:6388b760-70f1-47b6-a577-dd35569e080b for instance ba369ba5-73dc-42d2-a375-b15b0e42188c on hv-cinder-86022 Oct 06 04:38:58.960192 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-95097a58-a846-4108-b703-662bd374e371 req-be827493-0d59-4bd3-99d5-2faa9a5da39e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034731 Oct 06 04:38:58.961096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 427/856] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:38:59.385242 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:59.386114 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:59.393489 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:59.394228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:59.394568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:59.395372 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:59.396018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:59.396520 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:59.401188 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:38:59.432197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:59.432682 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:59.433147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:59.433592 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'fault' on Instance uuid ba369ba5-73dc-42d2-a375-b15b0e42188c {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:38:59.478818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:59.486515 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7bd930c3-397b-4607-9208-debd4c36e279 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1330 microversion: 2.1 time: 0.105290 Oct 06 04:38:59.487107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 430/857] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:59 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:59.604833 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:59.605537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:59.612165 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:59.612653 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:59.613088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:59.613821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:59.614226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:59.615273 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:59.752025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:59.757920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:38:59.758552 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:38:59.760521 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d7fed773-6440-410b-b0d6-49c64756cce1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.159756 Oct 06 04:38:59.765833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:59.765833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:59.765833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:59.766559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:38:59.767684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:38:59.768292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:38:59.771483 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 428/858] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:59 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:38:59.902466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:38:59.911152 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7510b7f1-02f4-44c4-a25e-bf8b2b2cf821 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1724 microversion: 2.1 time: 0.159125 Oct 06 04:38:59.912392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 431/859] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:38:59 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:39:00.511680 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:00.512223 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:00.518164 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:00.518649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:00.519121 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:00.519822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:00.520279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:00.521316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:00.550946 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:00.551441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:00.552381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:00.552823 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'fault' on Instance uuid ba369ba5-73dc-42d2-a375-b15b0e42188c {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:39:00.595161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:00.602705 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-35e7ac0e-4ea2-4734-bdea-65c7192ca824 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1330 microversion: 2.1 time: 0.094927 Oct 06 04:39:00.603306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 429/860] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:00 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:00.784381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:00.784871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:00.791513 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:00.791994 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:00.792427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:00.793117 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:00.793568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:00.793990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:00.922539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:00.933508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c925fc6c-de1e-4754-bed9-7270d67e419b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.152984 Oct 06 04:39:00.935344 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 432/861] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:00 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:00.936046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:00.936873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:00.943809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:00.944434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:00.944878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:00.945589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:00.946081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:00.946514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:01.076822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:01.085048 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1ce72548-1b06-4526-84f3-a648f6848c06 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1724 microversion: 2.1 time: 0.153375 Oct 06 04:39:01.085620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 430/862] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:00 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:39:01.625816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:01.626420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:01.632396 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:01.632874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:01.633301 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:01.633984 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:01.634433 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:01.634848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:01.665651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:01.666123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:01.666546 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:01.666999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'fault' on Instance uuid ba369ba5-73dc-42d2-a375-b15b0e42188c {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:39:01.710456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:01.718139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9e0292aa-836a-4bfe-894f-577c969f785a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 200 len: 1330 microversion: 2.1 time: 0.096207 Oct 06 04:39:01.718702 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 433/863] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:01 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:01.960699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:01.961251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:01.967530 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:01.968011 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:01.968445 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:01.969137 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:01.969586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:01.970007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:02.097543 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:02.106018 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-60ac9f38-244a-47bb-a9cd-a6a556aafa42 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.149838 Oct 06 04:39:02.106577 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 431/864] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:01 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:02.109448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:02.110090 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:02.116537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:02.117022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:02.117459 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:02.118153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:02.118607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:02.119379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:02.247314 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:02.255788 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-50f1a3b1-3acc-4dda-a7fc-0fdfcdb0a551 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1724 microversion: 2.1 time: 0.150659 Oct 06 04:39:02.256338 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 434/865] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:02 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:39:02.740831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:02.741441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:02.747678 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:02.748158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:02.748595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:02.749287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:02.749740 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:02.750164 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:02.765410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c HTTP/1.1 Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:39:02.767038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:39:02.768641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'ba369ba5-73dc-42d2-a375-b15b0e42188c'} Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:39:02.769754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:39:02.771876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:02.773327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:39:02.773327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-99b5cbfb-476f-43c5-ac4b-7a9ff1d6a63b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 404 len: 111 microversion: 2.1 time: 0.031748 Oct 06 04:39:02.773327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 432/866] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:02 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:39:02.777796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b6bd0524-809e-4b5d-8527-4a6bb9e9615c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '.version_select at 0x7f0c429f1940>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:02.796213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b6bd0524-809e-4b5d-8527-4a6bb9e9615c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-50069608" status: 202 len: 0 microversion: 2.1 time: 0.022290 Oct 06 04:39:02.796763 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 435/867] 10.222.0.33 () {58 vars in 1215 bytes} [Thu Oct 6 04:39:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-50069608 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:39:03.129117 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:03.129722 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:03.136970 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:03.137454 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:03.137891 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:03.138588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:03.139068 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:03.139493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:03.280593 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:03.281206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:03.287329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:03.287810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:03.288252 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:03.288953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:03.289437 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:03.289863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:03.329698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:03.339052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-93a00ca4-5381-43ec-a266-e56f62bf4f95 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.213702 Oct 06 04:39:03.339636 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 433/868] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:03 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:03.431736 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:03.440103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-785d2daa-5736-4441-86a0-457b2a0f77da tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1730 microversion: 2.1 time: 0.163924 Oct 06 04:39:03.440758 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 436/869] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:03 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:39:03.463443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:03.463936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:03.469737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:03.470226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:03.470665 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:03.471523 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:03.471982 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:03.472408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:03.511346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f8e2bf0e-e08d-4828-bd60-bde6dff74511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: .version_select at 0x7f0c42a2f280>, body: {"keypair": {"name": "tempest-keypair-655066248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr+FU/P2zaDRNZZH2NdP4Mw2ENAAQeATHxB74fNS/8TIId6/59znWu0ht1yim8IUCV4hSEtTK49kJ834/S0zMfdZVtQw4Yi9OhSS9goAAgp+3cRJEp4GtTQhZE4AssCzg=="}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:03.527277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-f8e2bf0e-e08d-4828-bd60-bde6dff74511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:39:03.531216 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-f8e2bf0e-e08d-4828-bd60-bde6dff74511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for user f68d73b5efc74b3380429cf72e506905 and project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:39:03.552553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d30cf36f-c50a-4658-8d2f-16f927e63e8c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092282 Oct 06 04:39:03.553530 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 434/870] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 04:39:03 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:39:03.554788 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f8e2bf0e-e08d-4828-bd60-bde6dff74511 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047445 Oct 06 04:39:03.555422 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 437/871] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:39:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:39:04.364729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:04.365284 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:04.372336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:04.372926 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:04.373437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:04.374536 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:04.375212 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:04.375537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:04.602235 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:04.610540 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1a5b80c5-bc85-4a05-aa57-ed90199c8814 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.250328 Oct 06 04:39:04.611563 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 435/872] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:04 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:39:04.788632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-a21c0df6-815c-4218-ac55-24c6f7e81daa req-471bbba2-8095-4980-9a18-b398a30d0edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48503bd-a381-4011-8f5d-3a4c45eb8e97", "tag": "e926f146-2ab3-4459-827a-f7a1a9e1e2de"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:04.804536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-a21c0df6-815c-4218-ac55-24c6f7e81daa req-471bbba2-8095-4980-9a18-b398a30d0edb service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:04.805149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-a21c0df6-815c-4218-ac55-24c6f7e81daa req-471bbba2-8095-4980-9a18-b398a30d0edb service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:04.805578 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-a21c0df6-815c-4218-ac55-24c6f7e81daa req-471bbba2-8095-4980-9a18-b398a30d0edb service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:04.817398 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-a21c0df6-815c-4218-ac55-24c6f7e81daa req-471bbba2-8095-4980-9a18-b398a30d0edb service nova] Creating event network-changed:e926f146-2ab3-4459-827a-f7a1a9e1e2de for instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 on hv-cinder-86022 Oct 06 04:39:04.823292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-a21c0df6-815c-4218-ac55-24c6f7e81daa req-471bbba2-8095-4980-9a18-b398a30d0edb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039324 Oct 06 04:39:04.824266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 438/873] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:39:04.832109 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-66426291", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45c9d327-544f-44d6-be7e-529008b00a93"}], "security_groups": [{"name": "tempest-securitygroup--1945243935"}], "key_name": "tempest-keypair-655066248", "user_data": "}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:04.961315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] validate_networks() for [('45c9d327-544f-44d6-be7e-529008b00a93', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:39:05.359189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:39:05.359620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:39:05.360093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:39:05.360503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:39:05.361473 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:39:05.371603 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:05.372221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:05.372501 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:05.373424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:05.373887 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:05.374315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:05.391673 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:39:05.396599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for user f68d73b5efc74b3380429cf72e506905 and project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:39:05.407849 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:39:05.410166 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:39:05.470378 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b5b87d41-c20f-4e6f-b6c3-472706b009b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.642607 Oct 06 04:39:05.477576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 436/874] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:39:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:39:05.483381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b83e63fe-11ff-4af6-9d03-889a5e3a3145 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:05.484148 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b83e63fe-11ff-4af6-9d03-889a5e3a3145 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:05.548645 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b83e63fe-11ff-4af6-9d03-889a5e3a3145 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:05.557110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b83e63fe-11ff-4af6-9d03-889a5e3a3145 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1239 microversion: 2.1 time: 0.077913 Oct 06 04:39:05.557723 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 439/875] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:05 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:05.635536 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:05.636154 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:05.645168 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:05.646366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:05.647177 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:05.647912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:05.648406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:05.648888 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:05.799003 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:05.808560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-47bef71d-4a93-498e-807f-16e44fdad8eb tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1676 microversion: 2.1 time: 0.176757 Oct 06 04:39:05.809140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 437/876] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:05 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:06.580584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:06.581193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:06.588345 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:06.588829 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:06.589272 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:06.589960 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:06.590412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:06.590837 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:06.654251 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:06.662684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-371377e6-2897-49ba-8385-6da3a9e63cb6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1291 microversion: 2.1 time: 0.086017 Oct 06 04:39:06.666252 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 440/877] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:06 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1291 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:06.831709 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:06.832395 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:06.840528 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:06.841021 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:06.841460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:06.841679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-e0f1136f-1a27-482f-94e0-c46ee1d45454 req-6b67700e-ee66-47f0-be9a-93c5dd28482b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48503bd-a381-4011-8f5d-3a4c45eb8e97", "tag": "e926f146-2ab3-4459-827a-f7a1a9e1e2de"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:06.842159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:06.842611 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:06.843060 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:06.852469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-e0f1136f-1a27-482f-94e0-c46ee1d45454 req-6b67700e-ee66-47f0-be9a-93c5dd28482b service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:06.853261 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-e0f1136f-1a27-482f-94e0-c46ee1d45454 req-6b67700e-ee66-47f0-be9a-93c5dd28482b service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:06.853891 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-e0f1136f-1a27-482f-94e0-c46ee1d45454 req-6b67700e-ee66-47f0-be9a-93c5dd28482b service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:06.865993 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-e0f1136f-1a27-482f-94e0-c46ee1d45454 req-6b67700e-ee66-47f0-be9a-93c5dd28482b service nova] Creating event network-changed:e926f146-2ab3-4459-827a-f7a1a9e1e2de for instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 on hv-cinder-86022 Oct 06 04:39:06.872051 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-e0f1136f-1a27-482f-94e0-c46ee1d45454 req-6b67700e-ee66-47f0-be9a-93c5dd28482b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034290 Oct 06 04:39:06.873306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 441/878] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:39:07.020243 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:07.029759 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-510702ec-2bac-4655-9870-83a915965297 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1653 microversion: 2.1 time: 0.202064 Oct 06 04:39:07.044232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 438/879] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:06 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1653 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:07.064070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c6e33875-ec16-4b1c-a5c5-47d79f1355f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:07.072583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6e33875-ec16-4b1c-a5c5-47d79f1355f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:07.073077 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6e33875-ec16-4b1c-a5c5-47d79f1355f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:07.073730 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6e33875-ec16-4b1c-a5c5-47d79f1355f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:07.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c6e33875-ec16-4b1c-a5c5-47d79f1355f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Going to try to start instance {{(pid=127098) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 04:39:07.139964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c6e33875-ec16-4b1c-a5c5-47d79f1355f7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/action" status: 202 len: 0 microversion: 2.1 time: 0.088327 Oct 06 04:39:07.140560 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 442/880] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:39:07 2022] POST /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:39:07.149513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:07.150122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:07.156054 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:07.157142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:07.157582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:07.158271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:07.158721 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:07.159186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:07.370017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:07.378644 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f326a9d2-c97a-48db-bab4-48e4124c2497 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1662 microversion: 2.1 time: 0.233677 Oct 06 04:39:07.379529 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 439/881] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:07 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1662 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:07.687028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:07.687818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:07.689956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:07.696043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:07.696535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:07.696972 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:07.697675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:07.698131 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:07.698555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:07.793207 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:07.802366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9a3ab293-6c52-4bd5-8f1a-e703d8c889e5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1297 microversion: 2.1 time: 0.119660 Oct 06 04:39:07.803052 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 443/882] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:07 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:08.402502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:08.403079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:08.409558 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:08.410073 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:08.410490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:08.411810 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:08.412276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:08.412708 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:08.552399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:08.560123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fb00047b-5b91-4cf6-9b71-c9905c5ea9e5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1662 microversion: 2.1 time: 0.161719 Oct 06 04:39:08.560695 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 440/883] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:08 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:08.825849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:08.826454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:08.832934 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:08.833552 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:08.834107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:08.834814 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:08.835299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:08.835731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:09.044728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:09.054111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-681bacb6-2b04-4a06-9837-52ef85c9e7e9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1365 microversion: 2.1 time: 0.232113 Oct 06 04:39:09.054787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 444/884] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:08 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:09.153627 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-84caaa2b-9017-441c-b7ed-9c09a0cdacb2 req-3002970a-4e6b-46c3-9a70-7917102ce347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa90860d-54c2-4079-9291-a9bd449aa9da", "tag": "2659587a-fc4a-47ce-a346-515fe41fc5ad"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:09.163524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-84caaa2b-9017-441c-b7ed-9c09a0cdacb2 req-3002970a-4e6b-46c3-9a70-7917102ce347 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:09.164004 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-84caaa2b-9017-441c-b7ed-9c09a0cdacb2 req-3002970a-4e6b-46c3-9a70-7917102ce347 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:09.164435 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-84caaa2b-9017-441c-b7ed-9c09a0cdacb2 req-3002970a-4e6b-46c3-9a70-7917102ce347 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:09.175722 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-84caaa2b-9017-441c-b7ed-9c09a0cdacb2 req-3002970a-4e6b-46c3-9a70-7917102ce347 service nova] Creating event network-changed:2659587a-fc4a-47ce-a346-515fe41fc5ad for instance fa90860d-54c2-4079-9291-a9bd449aa9da on hv-cinder-86022 Oct 06 04:39:09.181150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-84caaa2b-9017-441c-b7ed-9c09a0cdacb2 req-3002970a-4e6b-46c3-9a70-7917102ce347 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031177 Oct 06 04:39:09.182257 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 441/885] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:39:09.583561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:09.584199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:09.590313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:09.590791 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:09.591254 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:09.591955 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:09.592428 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:09.592834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:09.792935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:09.801053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1285ca76-9665-4f8d-8f41-e03de7b2e4e8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1666 microversion: 2.1 time: 0.221548 Oct 06 04:39:09.802245 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 445/886] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:09 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1666 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:10.078674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:10.079418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:10.081327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:10.087084 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:10.087582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:10.088027 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:10.088733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:10.089195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:10.089630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:10.216633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:10.224742 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1d31ffd4-655b-4cda-ae43-d4b0f43558b8 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1365 microversion: 2.1 time: 0.151034 Oct 06 04:39:10.225307 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 442/887] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:10 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:11.248417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:11.249023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:11.255871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:11.256361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:11.256783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:11.257506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:11.257959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:11.258379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:11.391432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:11.399666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4b7a763f-3016-4b81-b25e-033aa9d5fc76 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1365 microversion: 2.1 time: 0.155097 Oct 06 04:39:11.400225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 446/888] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:11 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:12.422946 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:12.423699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:12.432553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:12.433051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:12.433489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:12.434204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:12.434663 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:12.435119 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:12.576914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:12.585852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b262fb98-58fe-4df6-88c0-7a18debd4226 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1365 microversion: 2.1 time: 0.166703 Oct 06 04:39:12.586446 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 443/889] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:12 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:13.614372 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:13.615689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:13.623218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:13.623218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:13.623607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:13.624323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:13.624777 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:13.625206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:13.758783 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:13.766487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-706531e9-e446-46ea-9fd8-8a6465e039f6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1365 microversion: 2.1 time: 0.160549 Oct 06 04:39:13.767611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 447/890] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:13 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:14.789937 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:14.790463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:14.796976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:14.797451 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:14.797883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:14.798570 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:14.799053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:14.799489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:14.933923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:14.942044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-936a5103-e074-4695-a2b9-ac4fb8df8c17 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1365 microversion: 2.1 time: 0.156127 Oct 06 04:39:14.942631 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 444/891] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:14 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:15.706647 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-6d283660-f277-4353-a1e3-cb92446c349f req-e1755d9d-18f6-4388-acdf-5b0dc9326fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa90860d-54c2-4079-9291-a9bd449aa9da", "name": "network-vif-plugged", "status": "completed", "tag": "2659587a-fc4a-47ce-a346-515fe41fc5ad"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:15.712883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:15.720347 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-6d283660-f277-4353-a1e3-cb92446c349f req-e1755d9d-18f6-4388-acdf-5b0dc9326fda service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:15.721235 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-6d283660-f277-4353-a1e3-cb92446c349f req-e1755d9d-18f6-4388-acdf-5b0dc9326fda service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:15.721674 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-6d283660-f277-4353-a1e3-cb92446c349f req-e1755d9d-18f6-4388-acdf-5b0dc9326fda service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:15.734023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-6d283660-f277-4353-a1e3-cb92446c349f req-e1755d9d-18f6-4388-acdf-5b0dc9326fda service nova] Creating event network-vif-plugged:2659587a-fc4a-47ce-a346-515fe41fc5ad for instance fa90860d-54c2-4079-9291-a9bd449aa9da on hv-cinder-86022 Oct 06 04:39:15.739375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-6d283660-f277-4353-a1e3-cb92446c349f req-e1755d9d-18f6-4388-acdf-5b0dc9326fda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036071 Oct 06 04:39:15.739967 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 448/892] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:39:15.965718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:15.966360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:15.968225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:15.969080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=6 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:15.976126 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:15.976652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:15.977088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:15.977795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:15.978248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:15.978706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:15.998085 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:16.110031 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:16.118174 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9eb00921-c559-49f8-be35-59fbac11a9d3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1365 microversion: 2.1 time: 0.156389 Oct 06 04:39:16.119001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 445/893] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:15 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:17.141581 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:17.142279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:17.149507 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:17.149990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:17.150456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:17.151202 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:17.151663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:17.152087 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:17.280295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:17.288047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1d640f40-80c8-471b-a96e-8b1b79c9e4e3 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1365 microversion: 2.1 time: 0.150615 Oct 06 04:39:17.288612 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 449/894] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:17 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:18.315464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:18.316071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:18.323032 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:18.323512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:18.323941 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:18.324631 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:18.325079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:18.325499 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:18.451513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:18.460622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-82d2aeae-d7a4-448c-81ff-27de74bfd886 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1554 microversion: 2.1 time: 0.148433 Oct 06 04:39:18.461201 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 446/895] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:39:18 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:39:18.483143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:18.483648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:18.490675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:18.491325 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:18.491843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:18.492536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:18.492986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:18.493433 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:18.496192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:18.572568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7768cf91-f3f7-4e44-b495-8adeb1ae4833 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093357 Oct 06 04:39:18.573164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 450/896] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 04:39:18 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:39:19.495588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-0a6fcabb-ae2f-4ee4-8eb0-dc15ef5fd380 req-96a63417-e26d-4fa2-a663-9ef9492a1f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa90860d-54c2-4079-9291-a9bd449aa9da", "tag": "2659587a-fc4a-47ce-a346-515fe41fc5ad"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:19.505366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-0a6fcabb-ae2f-4ee4-8eb0-dc15ef5fd380 req-96a63417-e26d-4fa2-a663-9ef9492a1f7f service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:19.505977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-0a6fcabb-ae2f-4ee4-8eb0-dc15ef5fd380 req-96a63417-e26d-4fa2-a663-9ef9492a1f7f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:19.507050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-0a6fcabb-ae2f-4ee4-8eb0-dc15ef5fd380 req-96a63417-e26d-4fa2-a663-9ef9492a1f7f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:19.520228 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-0a6fcabb-ae2f-4ee4-8eb0-dc15ef5fd380 req-96a63417-e26d-4fa2-a663-9ef9492a1f7f service nova] Creating event network-changed:2659587a-fc4a-47ce-a346-515fe41fc5ad for instance fa90860d-54c2-4079-9291-a9bd449aa9da on hv-cinder-86022 Oct 06 04:39:19.527517 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-0a6fcabb-ae2f-4ee4-8eb0-dc15ef5fd380 req-96a63417-e26d-4fa2-a663-9ef9492a1f7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035772 Oct 06 04:39:19.528192 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 447/897] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:39:47.369838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=15 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:47.370572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:47.375123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:47.375610 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:47.383133 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:47.383611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:47.384037 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:47.384720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:47.385164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:47.385579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:47.415529 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-32260cb7-1aea-405d-8154-f73c6ff3cff2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments/1fe75a32-42bc-410a-8b4d-80c24587b719" status: 200 len: 194 microversion: 2.20 time: 0.047725 Oct 06 04:39:47.416102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 451/898] 10.222.0.33 () {60 vars in 1454 bytes} [Thu Oct 6 04:39:47 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments/1fe75a32-42bc-410a-8b4d-80c24587b719 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:39:47.484072 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=11 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:47.484738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=10 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:39:47.490545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:47.491169 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:47.498537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:47.499057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:47.499498 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:47.500331 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:47.500788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:47.501220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:47.583287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lazy-loading 'services' on Instance uuid 74c46bbc-e699-4b17-99e5-d6a70df92e2c {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:39:47.653142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ae47cabe-46af-485c-ae06-9e8f36e320ec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "DELETE /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments/1fe75a32-42bc-410a-8b4d-80c24587b719" status: 202 len: 0 microversion: 2.20 time: 0.170643 Oct 06 04:39:47.653727 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 448/899] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Oct 6 04:39:47 2022] DELETE /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments/1fe75a32-42bc-410a-8b4d-80c24587b719 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:39:47.662678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:47.665008 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:47.671790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:47.672522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:47.672971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:47.673900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:47.674479 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:47.674903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:47.705921 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-00121555-4c4f-4a30-98a2-30abec85f4fb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047544 Oct 06 04:39:47.706943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 452/900] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 04:39:47 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:39:48.721036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:48.723268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:48.729915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:48.730418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:48.730851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:48.731582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:48.732029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:48.732447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:48.763446 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-afe3f894-cfd5-4c78-98c3-ee17fbf721f1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047697 Oct 06 04:39:48.763999 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 449/901] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 04:39:48 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:39:49.776390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:49.778571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:49.784955 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:49.785427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:49.785893 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:49.786886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:49.787360 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:49.787786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:49.815846 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-eee9763f-9f5f-45a0-b0fa-ed66bf8f0f1b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043409 Oct 06 04:39:49.816391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 453/902] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 04:39:49 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:39:49.878080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:49.878600 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:49.885563 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:49.886050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:49.886492 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:49.887217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:49.887676 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:49.888104 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:49.913123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:39:49.987959 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f52e28d4-901c-451b-ba81-43125e038312 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "DELETE /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 204 len: 0 microversion: 2.20 time: 0.113321 Oct 06 04:39:49.988729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 450/903] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Oct 6 04:39:49 2022] DELETE /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 04:39:49.997868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:49.998557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:50.004604 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:50.006129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:50.006595 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:50.007323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:50.007782 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:50.008210 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:50.141143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:50.149661 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:50.151230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:50.152415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-727a844e-ba5c-494e-a8a6-f92a6f6ec326 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.158644 Oct 06 04:39:50.152970 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 454/904] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:39:49 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:39:51.180240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:51.180935 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:51.187247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:51.187736 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:51.188174 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:51.188865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:51.189319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:51.189748 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:51.318508 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:51.326526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:51.328036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:51.329219 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-45720606-9928-4f52-bd2b-00a9614d3af0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.154012 Oct 06 04:39:51.329775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 451/905] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:39:51 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:39:52.354306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:52.354906 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:52.361386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:52.361870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:52.362300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:52.363014 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:52.363476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:52.363941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:52.905802 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:52.913942 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:52.915427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:52.916607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-af68a954-54c4-474c-92bc-f1cf4578898b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1722 microversion: 2.20 time: 0.566211 Oct 06 04:39:52.917394 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 455/906] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:39:52 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1722 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:39:53.376748 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-7d6f14da-ac68-4d6f-96a7-e122c0332f48 req-5d6c6db1-57cf-4d1f-b241-c5c78c866331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c46bbc-e699-4b17-99e5-d6a70df92e2c", "name": "network-vif-deleted", "tag": "542157e8-aced-4f6a-815d-a118c4b3ca2c"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:53.388740 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-7d6f14da-ac68-4d6f-96a7-e122c0332f48 req-5d6c6db1-57cf-4d1f-b241-c5c78c866331 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:53.389484 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-7d6f14da-ac68-4d6f-96a7-e122c0332f48 req-5d6c6db1-57cf-4d1f-b241-c5c78c866331 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:53.389919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-7d6f14da-ac68-4d6f-96a7-e122c0332f48 req-5d6c6db1-57cf-4d1f-b241-c5c78c866331 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:53.402729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-7d6f14da-ac68-4d6f-96a7-e122c0332f48 req-5d6c6db1-57cf-4d1f-b241-c5c78c866331 service nova] Creating event network-vif-deleted:542157e8-aced-4f6a-815d-a118c4b3ca2c for instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c on hv-cinder-86022 Oct 06 04:39:53.412169 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-7d6f14da-ac68-4d6f-96a7-e122c0332f48 req-5d6c6db1-57cf-4d1f-b241-c5c78c866331 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036657 Oct 06 04:39:53.413468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 452/907] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:39:53.941939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:53.943098 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:53.949996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:53.950494 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:53.950938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:53.951860 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:53.952314 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:53.952741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:53.986629 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:53.987151 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:53.987589 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:53.988040 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lazy-loading 'fault' on Instance uuid 74c46bbc-e699-4b17-99e5-d6a70df92e2c {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:39:54.035903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:54.044143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:54.045731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:54.046888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6ce07c37-3d2d-45a6-b5ab-44f1aa6208cf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 200 len: 1371 microversion: 2.20 time: 0.109071 Oct 06 04:39:54.047496 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 456/908] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:39:53 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:39:55.074872 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:55.075624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:55.081785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:55.082277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:55.083926 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:55.084643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:55.085107 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:55.085549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:55.098836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] HTTP exception thrown: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Request method failure captured: Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c HTTP/1.1 Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpZ3cZFMm3st8zDeTCQAZb6soIpE8Q4yQm5eMUKICGtqVsK-PglDOrIPpcG1KQzxb0A-Ax0OLCAsHncavzmo-ujcqVax_qtgW_ogElVA275opERWW7ix5gabXicZBmEk4IsA2f3_sVWpTrvvFMZHORLYU04e08JKdz0KX5VMvjrBNA Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:39:55.100507 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_594a13a702cf47898a48ab4fd6789359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: d574235b791e485aa64130c599539945 Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:39:55.102195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '74c46bbc-e699-4b17-99e5-d6a70df92e2c'} Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:39:55.103188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:39:55.104775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:39:55.106240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Returning 404 to user: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:39:55.106240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d23bb265-9f01-4193-b07b-8de4b65a5236 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 404 len: 111 microversion: 2.20 time: 0.031773 Oct 06 04:39:55.106240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 453/909] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:39:55 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:39:55.110726 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cde8737e-ea2c-430c-b8a8-60302f4a13ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '.version_select at 0x7f0c42935b80>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:55.129143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-cde8737e-ea2c-430c-b8a8-60302f4a13ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030917819" status: 204 len: 0 microversion: 2.20 time: 0.022258 Oct 06 04:39:55.130233 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 457/910] 10.222.0.33 () {60 vars in 1262 bytes} [Thu Oct 6 04:39:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030917819 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 06 04:39:55.765334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0c964129-f5e6-4b19-818c-bbb12e2eb8da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'create', calling method: .version_select at 0x7f0c429479d0>, body: {"keypair": {"name": "tempest-keypair-2092163188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4yh/Z9aY32BBAlmZpdTHW+YnMLROHNrlHGkypBRvLIrRAzMrFsNwxRhen1HRDl1qpqm+NJ9tzh6d22jewU+LWFTzWJx/s3Lpk3V8BDZzR5hHqXGkoOpEQYrjCwxRUPdQ=="}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:55.780531 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-0c964129-f5e6-4b19-818c-bbb12e2eb8da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Getting quotas for project 594a13a702cf47898a48ab4fd6789359. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:39:55.784462 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-0c964129-f5e6-4b19-818c-bbb12e2eb8da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Getting quotas for user d574235b791e485aa64130c599539945 and project 594a13a702cf47898a48ab4fd6789359. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:39:55.797141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0c964129-f5e6-4b19-818c-bbb12e2eb8da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [8eedb5d7-9b25-4eba-b20c-aec1510b7481] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 04:39:56.804779 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO oslo.messaging._drivers.impl_rabbit [None req-0c964129-f5e6-4b19-818c-bbb12e2eb8da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [8eedb5d7-9b25-4eba-b20c-aec1510b7481] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59568. Oct 06 04:39:56.820406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0c964129-f5e6-4b19-818c-bbb12e2eb8da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.059043 Oct 06 04:39:56.821136 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 454/911] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Oct 6 04:39:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1060 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 04:39:58.070818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2006660485", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b586c8b5-56f0-4e30-8c9b-f6b5b9731066"}], "security_groups": [{"name": "tempest-securitygroup--1241933650"}], "key_name": "tempest-keypair-2092163188", "user_data": "}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:39:58.171906 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] validate_networks() for [('b586c8b5-56f0-4e30-8c9b-f6b5b9731066', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:39:58.541882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:39:58.542333 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:39:58.542800 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:39:58.543234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:39:58.543640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:39:58.552804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:58.553273 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:58.553700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:58.554419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:58.554873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:58.555315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:58.572699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Getting quotas for project 594a13a702cf47898a48ab4fd6789359. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:39:58.576623 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Getting quotas for user d574235b791e485aa64130c599539945 and project 594a13a702cf47898a48ab4fd6789359. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:39:58.587407 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:39:58.589657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:39:58.636074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-75b2187e-a5f7-4c77-b711-18b9c482b16b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.571227 Oct 06 04:39:58.636753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 458/912] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Oct 6 04:39:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 06 04:39:58.648717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d69d2bdf-4edb-4262-b2bf-10a351ef86b2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:58.649330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d69d2bdf-4edb-4262-b2bf-10a351ef86b2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:58.712363 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d69d2bdf-4edb-4262-b2bf-10a351ef86b2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:58.719895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d69d2bdf-4edb-4262-b2bf-10a351ef86b2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:58.721274 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d69d2bdf-4edb-4262-b2bf-10a351ef86b2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:58.722372 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d69d2bdf-4edb-4262-b2bf-10a351ef86b2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1282 microversion: 2.20 time: 0.078411 Oct 06 04:39:58.722926 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 455/913] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:39:58 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:39:59.749194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:39:59.749797 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:39:59.756840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:59.757315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:59.757793 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:59.759150 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:39:59.759755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:39:59.760205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:39:59.826595 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:59.835032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:59.836463 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:39:59.837557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-94a626cf-a91d-4917-84a0-e964faae76c6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1334 microversion: 2.20 time: 0.092734 Oct 06 04:39:59.838112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 459/914] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:39:59 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:40:00.863928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:00.864783 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:00.871424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:00.871911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:00.872341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:00.873042 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:00.873508 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:00.873920 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:01.014251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:01.023053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:01.024497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:01.025607 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4885c95d-80f7-4b38-bc33-1adeffb033a6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1408 microversion: 2.20 time: 0.165802 Oct 06 04:40:01.026167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 456/915] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:00 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:40:01.438138 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-449f3af2-f15b-4305-ac7b-6ef0546cb743 req-9e9a6fa0-686e-4476-87e2-607b6932f202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40", "tag": "e7a92c66-1f21-4c39-8bbe-215d0840346a"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:01.449217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-449f3af2-f15b-4305-ac7b-6ef0546cb743 req-9e9a6fa0-686e-4476-87e2-607b6932f202 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:01.449836 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-449f3af2-f15b-4305-ac7b-6ef0546cb743 req-9e9a6fa0-686e-4476-87e2-607b6932f202 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:01.450286 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-449f3af2-f15b-4305-ac7b-6ef0546cb743 req-9e9a6fa0-686e-4476-87e2-607b6932f202 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:01.463201 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-449f3af2-f15b-4305-ac7b-6ef0546cb743 req-9e9a6fa0-686e-4476-87e2-607b6932f202 service nova] Creating event network-changed:e7a92c66-1f21-4c39-8bbe-215d0840346a for instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 on hv-cinder-86022 Oct 06 04:40:01.467974 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-449f3af2-f15b-4305-ac7b-6ef0546cb743 req-9e9a6fa0-686e-4476-87e2-607b6932f202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033920 Oct 06 04:40:01.468573 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 460/916] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:40:02.050733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:02.051809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:02.059066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:02.059550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:02.059985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:02.060683 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:02.061133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:02.061553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:02.189432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:02.197488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:02.198915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:02.200031 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0e65768d-0a53-4821-9a59-41de67cdcd60 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1408 microversion: 2.20 time: 0.153311 Oct 06 04:40:02.200585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 457/917] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:02 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:40:03.226828 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:03.227487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:03.233816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:03.234302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:03.234734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:03.235461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:03.235945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:03.236369 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:03.366125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:03.374337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:03.375819 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:03.376913 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-60376f21-ef4e-4691-a595-5c4648d94bec tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1408 microversion: 2.20 time: 0.155485 Oct 06 04:40:03.377469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 461/918] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:03 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:40:04.173270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:04.175635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:04.183051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:04.183542 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:04.183980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:04.184674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:04.185131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:04.185558 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:04.260067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1b3ddccb-305f-4ff6-83f5-74ca83477cfc tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "POST /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/action" status: 202 len: 0 microversion: 2.1 time: 0.090665 Oct 06 04:40:04.263933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 458/919] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:40:04 2022] POST /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:40:04.272223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:04.272840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:04.281198 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:04.281692 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:04.282139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:04.282841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:04.283333 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:04.283841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:04.402595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:04.403319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:04.409364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:04.409849 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:04.410292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:04.411813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:04.412267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:04.412699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:04.430137 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:04.438254 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e40b0f60-39e9-4b6e-8a54-e1850000477a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1751 microversion: 2.1 time: 0.173067 Oct 06 04:40:04.438823 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 462/920] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:04 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:04.542408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:04.550615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:04.552766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:04.553890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-22b9027e-eff2-4fff-b26d-6712e8430f23 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1408 microversion: 2.20 time: 0.155706 Oct 06 04:40:04.554488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 459/921] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:04 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:40:05.463004 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:05.463628 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:05.470070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:05.470499 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:05.470940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:05.471663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:05.472121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:05.472549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:05.579325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:05.579926 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:05.587431 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:05.588306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:05.588967 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:05.590002 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:05.590657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:05.591115 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:05.623948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:05.632540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-809ef43e-f7af-4410-ac78-b976cda70420 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1751 microversion: 2.1 time: 0.173415 Oct 06 04:40:05.633602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 463/922] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:05 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:05.728234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:05.736629 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:05.738073 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:05.739334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fb636afe-8241-4454-9adf-028fe4eec20f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1408 microversion: 2.20 time: 0.163866 Oct 06 04:40:05.739809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 460/923] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:05 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:40:06.656722 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:06.657336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:06.664410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:06.664890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:06.665325 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:06.666013 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:06.666460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:06.666883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:06.764096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:06.764706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:06.771811 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:06.772297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:06.772737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:06.773439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:06.773895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:06.774321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:06.809921 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:06.818248 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3822bac7-79ae-427e-9b04-6d27e4fc1453 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.165327 Oct 06 04:40:06.818832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 464/924] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:06 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:06.903112 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:06.911128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:06.912565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:06.913663 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6439cbe2-21bd-415b-ad0a-7d33ffa97ed7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1408 microversion: 2.20 time: 0.153448 Oct 06 04:40:06.914216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 461/925] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:06 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:40:07.842143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:07.842869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:07.849947 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:07.850430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:07.850862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:07.851592 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:07.852045 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:07.852469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:07.892378 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-d704a26f-1038-4908-b1f9-eeb6342bab8a req-050af7ac-8880-4d17-a063-e572c7049bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40", "name": "network-vif-plugged", "status": "completed", "tag": "e7a92c66-1f21-4c39-8bbe-215d0840346a"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:07.903817 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-d704a26f-1038-4908-b1f9-eeb6342bab8a req-050af7ac-8880-4d17-a063-e572c7049bc6 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:07.904417 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-d704a26f-1038-4908-b1f9-eeb6342bab8a req-050af7ac-8880-4d17-a063-e572c7049bc6 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:07.905028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-d704a26f-1038-4908-b1f9-eeb6342bab8a req-050af7ac-8880-4d17-a063-e572c7049bc6 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:07.917721 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-d704a26f-1038-4908-b1f9-eeb6342bab8a req-050af7ac-8880-4d17-a063-e572c7049bc6 service nova] Creating event network-vif-plugged:e7a92c66-1f21-4c39-8bbe-215d0840346a for instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 on hv-cinder-86022 Oct 06 04:40:07.922660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-d704a26f-1038-4908-b1f9-eeb6342bab8a req-050af7ac-8880-4d17-a063-e572c7049bc6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033683 Oct 06 04:40:07.923490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 462/926] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:40:07.939211 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:07.940181 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:07.947584 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:07.948198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:07.948710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:07.949535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:07.950229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:07.950726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:08.010242 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:08.018557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-14dc1df0-65cc-4056-96ba-b36c87df636a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.180268 Oct 06 04:40:08.019152 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 465/927] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:07 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:08.341590 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:08.351034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:08.352473 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:08.353584 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e672ceea-69d4-43a5-925b-78133d46c976 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1408 microversion: 2.20 time: 0.419614 Oct 06 04:40:08.354135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 463/928] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:07 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:40:09.043615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:09.044224 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:09.046240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:09.046997 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:09.053896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:09.054378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:09.054816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:09.055516 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:09.055969 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:09.056384 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:09.197764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:09.206145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0df42763-1bdb-4103-a3e3-d9de6bc1e0d4 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.167158 Oct 06 04:40:09.206717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 466/929] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:09 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:09.378106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:09.378716 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:09.381156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=6 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:09.386905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:09.387420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:09.387861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:09.388566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:09.389024 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:09.389453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:09.517353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:09.525995 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:09.527444 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:09.528544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5e819065-da56-40d0-a401-5d9793102f07 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1408 microversion: 2.20 time: 0.154340 Oct 06 04:40:09.529093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 464/930] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:09 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:40:10.229469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:10.230078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:10.236677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:10.237163 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:10.237603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:10.238307 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:10.239943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:10.240381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:10.391663 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:10.402361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-277f7802-66c9-4b68-ade6-d272ed52e597 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.176681 Oct 06 04:40:10.403070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 467/931] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:10 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:10.553805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:10.554419 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:10.560904 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:10.561387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:10.561858 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:10.562553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:10.563041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:10.563471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:10.567725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:10.694517 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:10.702432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:10.703888 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:10.705023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-28595ba1-69fc-4b3e-8b32-2396ab4d141b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1601 microversion: 2.20 time: 0.155484 Oct 06 04:40:10.705573 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 465/932] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:40:10 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:40:10.729469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:10.729882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:10.735713 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:10.736189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:10.736619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:10.737298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:10.737743 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:10.738159 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:10.812657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-13a5ecdf-11be-4a6c-bf51-c0cd1062546f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087098 Oct 06 04:40:10.813247 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 468/933] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Oct 6 04:40:10 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:40:11.307983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:11.308482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:11.314373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:11.314851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:11.315321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:11.316019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:11.317225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:11.317749 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:11.397791 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lazy-loading 'services' on Instance uuid a48503bd-a381-4011-8f5d-3a4c45eb8e97 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:40:11.425348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:11.426555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:11.435691 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:11.435907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:11.436211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:11.436953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:11.437681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:11.438107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:11.477057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4263393e-2e06-4565-b584-d2a7d37b47d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments/8d624c89-df3f-4e41-a66d-3d003d7be521" status: 202 len: 0 microversion: 2.1 time: 0.172924 Oct 06 04:40:11.478262 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 466/934] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:40:11 2022] DELETE /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments/8d624c89-df3f-4e41-a66d-3d003d7be521 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:40:11.487223 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:11.490548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:11.497211 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:11.497704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:11.498217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:11.499163 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:11.499601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:11.500026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:11.530839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-79c41a2a-8975-4042-981d-2d8e2d841e3c tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047790 Oct 06 04:40:11.535082 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 467/935] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:40:11 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:40:11.732460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:11.736093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=100 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:11.742921 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-06d80b92-24c1-4e7e-8bd5-c11d1bdefcae tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.321191 Oct 06 04:40:11.743752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 469/936] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:11 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:12.079836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-492bbfb7-a058-435d-852f-36512f1339cc req-0c19d5cc-d311-440a-8f48-74dd427ffc88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40", "tag": "e7a92c66-1f21-4c39-8bbe-215d0840346a"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:12.090535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-492bbfb7-a058-435d-852f-36512f1339cc req-0c19d5cc-d311-440a-8f48-74dd427ffc88 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:12.091144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-492bbfb7-a058-435d-852f-36512f1339cc req-0c19d5cc-d311-440a-8f48-74dd427ffc88 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:12.091650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-492bbfb7-a058-435d-852f-36512f1339cc req-0c19d5cc-d311-440a-8f48-74dd427ffc88 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:12.105815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-492bbfb7-a058-435d-852f-36512f1339cc req-0c19d5cc-d311-440a-8f48-74dd427ffc88 service nova] Creating event network-changed:e7a92c66-1f21-4c39-8bbe-215d0840346a for instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 on hv-cinder-86022 Oct 06 04:40:12.111460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-492bbfb7-a058-435d-852f-36512f1339cc req-0c19d5cc-d311-440a-8f48-74dd427ffc88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035185 Oct 06 04:40:12.112352 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 468/937] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:12.543640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:12.545982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:12.553225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:12.553721 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:12.554161 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:12.554920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:12.555402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:12.555831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:12.592547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-009f3151-b660-41ce-ab47-c2b2f392cb60 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052786 Oct 06 04:40:12.593609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 470/938] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:40:12 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:12.767924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:12.768706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:12.775644 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:12.776139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:12.776628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:12.777343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:12.777798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:12.778228 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:12.950325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:12.959702 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b4ad35d1-0582-4f13-b22b-786a6374266b tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.196540 Oct 06 04:40:12.960306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 469/939] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:12 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:13.605933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:13.608306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:13.617584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:13.618434 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:13.619522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:13.620767 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:13.621582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:13.622356 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:13.666796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d41ea31b-e9e2-4e64-a794-0b36b72f62cf tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064860 Oct 06 04:40:13.673664 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 471/940] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:40:13 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:40:13.750929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:13.751497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:13.758774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:13.759291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:13.759731 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:13.760426 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:13.760882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:13.761309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:13.788018 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:40:13.865311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a45f9d39-3fc0-4449-989d-3edee5a80ad2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 204 len: 0 microversion: 2.1 time: 0.117949 Oct 06 04:40:13.865883 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 470/941] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:40:13 2022] DELETE /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:40:13.874651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:13.875283 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:13.881908 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:13.882390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:13.882821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:13.883547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:13.883998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:13.884415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:13.984651 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:13.985439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:13.991938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:13.992500 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:13.993001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:13.993786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:13.994687 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:13.995207 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:14.027425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:14.035414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-31047cbe-7099-4a6c-843a-bae5efe82465 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1690 microversion: 2.1 time: 0.164563 Oct 06 04:40:14.035996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 472/942] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:13 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:14.152477 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:14.161342 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d255ba7e-44c8-46e2-9652-9eb69cbc9f01 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.180907 Oct 06 04:40:14.161911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 471/943] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:13 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:15.063146 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:15.063786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:15.070250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:15.070727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:15.071196 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:15.071885 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:15.072334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:15.072754 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:15.184969 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:15.185583 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:15.191915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:15.192399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:15.193482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:15.194341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:15.194800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:15.195260 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:15.203677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:15.212862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-01b1a2c3-49e1-47a4-996f-98d7e94dcb97 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1690 microversion: 2.1 time: 0.155866 Oct 06 04:40:15.213429 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 473/944] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:15 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:15.338711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:15.347031 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4d83fad4-0eec-40b3-aa6f-bf0110ff26a0 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.165878 Oct 06 04:40:15.347597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 472/945] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:15 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:16.236059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:16.236691 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:16.243577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:16.244305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:16.244736 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:16.245415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:16.245864 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:16.246281 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:16.377710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:16.378520 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:16.381961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:16.385700 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:16.386190 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:16.386628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:16.387363 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:16.387826 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:16.388251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:16.389552 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3a36fc40-54b6-4d77-a878-187c33c8ffa4 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1690 microversion: 2.1 time: 0.157408 Oct 06 04:40:16.390118 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 474/946] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:16 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:16.528498 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:16.537816 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ac32633e-b978-4b55-9d04-eec4a3e7fca9 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.162843 Oct 06 04:40:16.538395 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 473/947] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:16 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:17.083377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:17.085700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:17.091776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.092276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.092712 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.093418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.093878 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.094303 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.124881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c6a0a996-d010-4f12-b55c-c827af553fab tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045616 Oct 06 04:40:17.125445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 475/948] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:40:17 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:40:17.187751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:17.188243 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:17.194209 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.194685 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.195151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.195836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.196286 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.196710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.221703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:40:17.294598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5eee0820-49f0-4bc2-ac7a-c5afe9c20674 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 204 len: 0 microversion: 2.1 time: 0.110249 Oct 06 04:40:17.295113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 474/949] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:40:17 2022] DELETE /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 04:40:17.303512 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:17.304121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:17.310443 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.310925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.311392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.312084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.312537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.312961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.413354 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:17.414406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:17.421744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.422467 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.423245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.423970 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.424591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.425029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.452279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:17.461075 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-bac89926-db13-4cc8-95a4-1099519f3397 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1672 microversion: 2.1 time: 0.161355 Oct 06 04:40:17.461650 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 476/950] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:17 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:17.561371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:17.561891 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:17.563888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:17.566387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:17.569569 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.570059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.570496 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.571227 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:17.571681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:17.572114 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:17.574285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f9b75629-f09c-4564-9b5f-023e495ddf65 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1690 microversion: 2.1 time: 0.165316 Oct 06 04:40:17.574912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 475/951] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:17 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:17.716934 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:17.725982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8c15b605-bcd9-4395-93fc-019fc4e84815 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1756 microversion: 2.1 time: 0.168590 Oct 06 04:40:17.726550 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 477/952] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:17 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:18.484708 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:18.485353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:18.487816 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:18.494676 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:18.495242 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:18.495714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:18.496420 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:18.496881 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:18.497311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:18.597741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:18.598373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:18.605317 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:18.605801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:18.606236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:18.606980 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:18.607426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:18.607850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:18.628822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:18.637672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2efb0e09-c6b0-410b-b271-4ad4d5b35f64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1672 microversion: 2.1 time: 0.156817 Oct 06 04:40:18.638180 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 476/953] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:18 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:18.749489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:18.750098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:18.756639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:18.757134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:18.757568 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:18.758268 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:18.758685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:18.758821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:18.759164 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:18.766360 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8b456f4c-024e-465d-ab75-2e4656080f0e tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1690 microversion: 2.1 time: 0.172487 Oct 06 04:40:18.766917 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 478/954] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:18 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:18.905136 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:18.914017 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d0967cf2-5ba6-4294-9c17-8bad6f60cbe3 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1759 microversion: 2.1 time: 0.168465 Oct 06 04:40:18.914576 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 477/955] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:18 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:19.671555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:19.672195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:19.679122 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:19.679699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:19.680132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:19.680869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:19.681319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:19.681741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:19.789795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:19.790402 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:19.797137 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:19.797614 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:19.798043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:19.798738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:19.799222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:19.799640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:19.818071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:19.938535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:19.947902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cec4ed74-cf6d-4d68-8cbc-7c6a75903409 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1690 microversion: 2.1 time: 0.162069 Oct 06 04:40:19.948857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 478/956] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:19 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:20.031752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:20.040246 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2e75a140-2626-46e0-a957-9b21bacec0c5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1672 microversion: 2.1 time: 0.372520 Oct 06 04:40:20.041153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 479/957] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:19 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1672 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:20.972278 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:20.972819 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:20.979222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:20.979704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:20.980133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:20.980832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:20.981280 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:20.981809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:21.048714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:21.058188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5b0c7744-1ef1-4539-a3e4-9e3a55d586a5 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 200 len: 1622 microversion: 2.1 time: 0.088678 Oct 06 04:40:21.063363 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:21.064189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:21.071886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:21.072387 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:21.072566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 479/958] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:20 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 1622 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:21.072828 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:21.073540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:21.081183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:21.082735 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:21.083800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-8cad8a69-499e-4b5c-b449-933572a31361 req-dc2667d4-4827-4932-b468-1c6bd792d84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48503bd-a381-4011-8f5d-3a4c45eb8e97", "name": "network-vif-deleted", "tag": "e926f146-2ab3-4459-827a-f7a1a9e1e2de"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:21.095350 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8cad8a69-499e-4b5c-b449-933572a31361 req-dc2667d4-4827-4932-b468-1c6bd792d84c service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:21.095935 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8cad8a69-499e-4b5c-b449-933572a31361 req-dc2667d4-4827-4932-b468-1c6bd792d84c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:21.096861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8cad8a69-499e-4b5c-b449-933572a31361 req-dc2667d4-4827-4932-b468-1c6bd792d84c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:21.111137 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-8cad8a69-499e-4b5c-b449-933572a31361 req-dc2667d4-4827-4932-b468-1c6bd792d84c service nova] Creating event network-vif-deleted:e926f146-2ab3-4459-827a-f7a1a9e1e2de for instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 on hv-cinder-86022 Oct 06 04:40:21.116965 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-8cad8a69-499e-4b5c-b449-933572a31361 req-dc2667d4-4827-4932-b468-1c6bd792d84c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040481 Oct 06 04:40:21.118252 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 480/959] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:40:21.189643 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:21.199938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-740812e6-82e6-4301-a116-c5fa45229d62 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1604 microversion: 2.1 time: 0.140296 Oct 06 04:40:21.200601 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 480/960] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:21 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1604 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:22.082791 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:22.084281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: a48503bd-a381-4011-8f5d-3a4c45eb8e97] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:22.091099 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:22.091590 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:22.092041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:22.092755 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:22.093205 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:22.093762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:22.109090 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] HTTP exception thrown: Instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 could not be found. Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Request method failure captured: Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 HTTP/1.1 Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpdmJ34Bmk4FmKO5HlGen5bIAzhZqAQylenpJ7_85ZNW-tfMBrtX5dNifLzg9qKz4HDOyxWOxuVA4Tc996oHqqYYeK8DZho_hK92ett81rJJ3pmHidzYBDzAXuAqnUY0__1XlKsU871-sBzdrj8JiETRmBx_OUIVSIuhEghLwqhEq0 Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:40:22.110886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: a58cd041c02d46dcb8acf6adb11ee9de Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 could not be found. Oct 06 04:40:22.112585 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'a48503bd-a381-4011-8f5d-3a4c45eb8e97'} Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 could not be found. Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:40:22.113812 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 could not be found. Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 could not be found. Oct 06 04:40:22.115406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:22.116734 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Returning 404 to user: Instance a48503bd-a381-4011-8f5d-3a4c45eb8e97 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:40:22.116734 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-29d866d9-8da3-4834-a976-a792c02604e2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97" status: 404 len: 111 microversion: 2.1 time: 0.035673 Oct 06 04:40:22.118410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 481/961] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:22 2022] GET /compute/v2.1/servers/a48503bd-a381-4011-8f5d-3a4c45eb8e97 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:40:22.123992 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f3bed60d-35e7-4c3f-bd1d-246af27d2882 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '.version_select at 0x7f0c42a6a700>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:22.146380 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f3bed60d-35e7-4c3f-bd1d-246af27d2882 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-761951345" status: 202 len: 0 microversion: 2.1 time: 0.025731 Oct 06 04:40:22.147351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 481/962] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Oct 6 04:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-761951345 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 04:40:22.229871 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:22.230786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:22.237125 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:22.237861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:22.238602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:22.240132 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:22.241076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:22.241674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:22.278852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:22.279692 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:22.283057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:22.284370 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lazy-loading 'fault' on Instance uuid dc52256a-9199-4650-94d2-898dc19ce71d {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:40:22.338658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:22.372965 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-22ab358b-7ca2-4eba-aa47-9848e637aac6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 200 len: 1327 microversion: 2.1 time: 0.152616 Oct 06 04:40:22.379789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 482/963] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:22 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:23.135104 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-596c13e7-ba98-4a57-a1fc-aa8c704f5cc4 req-e83c1968-bfa3-44ce-9551-6916c23cca29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc52256a-9199-4650-94d2-898dc19ce71d", "name": "network-vif-deleted", "tag": "09cdf9f1-3de3-4c28-bc6f-d5c72cb9470e"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:23.145481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-596c13e7-ba98-4a57-a1fc-aa8c704f5cc4 req-e83c1968-bfa3-44ce-9551-6916c23cca29 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:23.145962 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-596c13e7-ba98-4a57-a1fc-aa8c704f5cc4 req-e83c1968-bfa3-44ce-9551-6916c23cca29 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:23.146537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-596c13e7-ba98-4a57-a1fc-aa8c704f5cc4 req-e83c1968-bfa3-44ce-9551-6916c23cca29 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:23.156521 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-596c13e7-ba98-4a57-a1fc-aa8c704f5cc4 req-e83c1968-bfa3-44ce-9551-6916c23cca29 service nova] Creating event network-vif-deleted:09cdf9f1-3de3-4c28-bc6f-d5c72cb9470e for instance dc52256a-9199-4650-94d2-898dc19ce71d on hv-cinder-86022 Oct 06 04:40:23.161678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-596c13e7-ba98-4a57-a1fc-aa8c704f5cc4 req-e83c1968-bfa3-44ce-9551-6916c23cca29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030867 Oct 06 04:40:23.162254 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 482/964] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:23.404202 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:23.404737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:23.411151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:23.411656 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:23.412089 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:23.413330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:23.413891 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:23.414317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:23.427234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] HTTP exception thrown: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Request method failure captured: Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d HTTP/1.1 Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpYC2BUnG4ObdHzyWGzWkBLMhja9vEdOfbzpI18tEBYbvfYTNyb-DEZYbnieVgFuBNRIHKd1ctD20-7k278JLkDda5yjGCYJwdWjOeCHEsDnrRmlmpFmlEyYUxk8JWq2uDT7eOjTxFnG9dPc9dPHz_S0FyoBN96cTJr9P49Ldfp3GM Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:40:23.429330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 56c86f73f98a4fb2af787534fd47e2ed Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:40:23.431039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'dc52256a-9199-4650-94d2-898dc19ce71d'} Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:40:23.432178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:40:23.433661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:23.435266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Returning 404 to user: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:40:23.435266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-01be58a5-7a29-467e-91e0-746b09274388 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 404 len: 111 microversion: 2.1 time: 0.030389 Oct 06 04:40:23.435266 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 483/965] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:23 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:40:23.440703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a44f51da-7de2-4902-b75b-3a9d370506e0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '.version_select at 0x7f0c42b6cf70>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:23.458343 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a44f51da-7de2-4902-b75b-3a9d370506e0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561560247" status: 202 len: 0 microversion: 2.1 time: 0.021889 Oct 06 04:40:23.458874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 483/966] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Oct 6 04:40:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561560247 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:40:24.094836 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cb6a628b-702f-4e80-ba9e-e99c30c174a8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'create', calling method: .version_select at 0x7f0c42965ee0>, body: {"keypair": {"name": "tempest-keypair-538593011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYiB1chqMupztq8++YIxbNgBfiOJcFn9x0vTfcRwZVbSpJfjr6M/NEcDwk1iQi7RGo/91xTbbIIznYX10UjrEZysu8KjzPxyJ3tMCClmpA+pemoQFoipLxtEKK8XJNUcQ=="}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:24.109963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-cb6a628b-702f-4e80-ba9e-e99c30c174a8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Getting quotas for project f53abe2cc7a94ddaadb68b26b57faf69. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:40:24.113725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-cb6a628b-702f-4e80-ba9e-e99c30c174a8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Getting quotas for user 56c86f73f98a4fb2af787534fd47e2ed and project f53abe2cc7a94ddaadb68b26b57faf69. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:40:24.136384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cb6a628b-702f-4e80-ba9e-e99c30c174a8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045406 Oct 06 04:40:24.137141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 484/967] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:40:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:25.121100 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:25.121721 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:25.128103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:25.128588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:25.129019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:25.129710 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:25.130177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:25.130583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:25.158062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:40:25.243616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5dc800c0-8daf-42ce-9a4f-c82aa52254d3 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 204 len: 0 microversion: 2.1 time: 0.126958 Oct 06 04:40:25.244738 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 484/968] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:40:25 2022] DELETE /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:40:25.253776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:25.254396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:25.262188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:25.262677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:25.263158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:25.263863 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:25.264329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:25.264757 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:25.383375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-932515431", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dda97116-7fb3-4466-b2df-d492cd1f2494"}], "security_groups": [{"name": "tempest-securitygroup--742352544"}], "key_name": "tempest-keypair-538593011", "user_data": "}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:25.399487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:25.407491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-81901cae-fd7c-4d41-b0a3-e8185e7fde76 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1507 microversion: 2.1 time: 0.158328 Oct 06 04:40:25.408193 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 485/969] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:25 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:25.489420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] validate_networks() for [('dda97116-7fb3-4466-b2df-d492cd1f2494', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:40:25.859803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:40:25.860223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:40:25.860721 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:40:25.861125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:40:25.861531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:40:25.876243 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:25.876991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:25.877421 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:25.878147 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:25.878602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:25.879046 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:25.895899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Getting quotas for project f53abe2cc7a94ddaadb68b26b57faf69. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:40:25.900141 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Getting quotas for user 56c86f73f98a4fb2af787534fd47e2ed and project f53abe2cc7a94ddaadb68b26b57faf69. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:40:25.911032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:40:25.914019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:40:25.961707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1eaad28f-b9f3-4e16-90b5-af8afa020bb2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.584183 Oct 06 04:40:25.962351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 485/970] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:40:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 04:40:25.973230 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-10ecbf33-9198-454a-b74e-008e6791cac2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:25.973840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-10ecbf33-9198-454a-b74e-008e6791cac2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:26.029820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-10ecbf33-9198-454a-b74e-008e6791cac2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:26.039173 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-10ecbf33-9198-454a-b74e-008e6791cac2 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1236 microversion: 2.1 time: 0.069577 Oct 06 04:40:26.039764 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 486/971] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:25 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:26.429775 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:26.431058 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:26.438293 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:26.439137 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:26.439752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:26.440617 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:26.441211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:26.441796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:26.679571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:26.687970 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-63927894-5c95-4e9d-af3a-ec2ec6aa6539 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1507 microversion: 2.1 time: 0.262115 Oct 06 04:40:26.688550 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 486/972] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:26 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:26.869384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-d82d252c-2f61-4a6b-9dd8-684837455719 req-0afbfac5-41e4-41bd-b11d-6867e041a0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d111c647-dca9-45d6-96c6-13169658cac9", "name": "network-vif-deleted", "tag": "b2a8d8d0-e0de-4959-a7d2-0d6f5be5fb38"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:26.879838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-d82d252c-2f61-4a6b-9dd8-684837455719 req-0afbfac5-41e4-41bd-b11d-6867e041a0e0 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:26.880412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-d82d252c-2f61-4a6b-9dd8-684837455719 req-0afbfac5-41e4-41bd-b11d-6867e041a0e0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:26.880957 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-d82d252c-2f61-4a6b-9dd8-684837455719 req-0afbfac5-41e4-41bd-b11d-6867e041a0e0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:26.891454 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-d82d252c-2f61-4a6b-9dd8-684837455719 req-0afbfac5-41e4-41bd-b11d-6867e041a0e0 service nova] Creating event network-vif-deleted:b2a8d8d0-e0de-4959-a7d2-0d6f5be5fb38 for instance d111c647-dca9-45d6-96c6-13169658cac9 on hv-cinder-86022 Oct 06 04:40:26.896315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-d82d252c-2f61-4a6b-9dd8-684837455719 req-0afbfac5-41e4-41bd-b11d-6867e041a0e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030863 Oct 06 04:40:26.897815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 487/973] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:27.064020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:27.064578 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:27.071239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:27.071687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:27.072121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:27.072803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:27.073250 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:27.073667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:27.137831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:27.152639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-64fd9ac8-4f95-4c34-bd54-34f65145f205 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1288 microversion: 2.1 time: 0.092519 Oct 06 04:40:27.163531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 487/974] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:27 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:27.721041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:27.721755 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:27.729787 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:27.730299 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:27.730733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:27.731479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:27.731937 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:27.732586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:27.763249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:27.763781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:27.764165 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:27.764645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lazy-loading 'fault' on Instance uuid d111c647-dca9-45d6-96c6-13169658cac9 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:40:27.808218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:27.815870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-eb047400-8f46-404d-86d1-0955fff7b3d0 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 200 len: 1311 microversion: 2.1 time: 0.108018 Oct 06 04:40:27.816441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 488/975] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:27 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:28.176223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:28.176830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:28.183814 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:28.184555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:28.184994 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:28.185690 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:28.186140 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:28.186565 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:28.190941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:28.276135 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:28.283914 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e4743c52-e894-4162-8272-250c8da8a9f8 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1294 microversion: 2.1 time: 0.111516 Oct 06 04:40:28.284488 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 488/976] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:28 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:28.839550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:28.840279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: d111c647-dca9-45d6-96c6-13169658cac9] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:28.846744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:28.847271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:28.847710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:28.848413 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:28.848874 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:28.849309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:28.863486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] HTTP exception thrown: Instance d111c647-dca9-45d6-96c6-13169658cac9 could not be found. Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Request method failure captured: Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 HTTP/1.1 Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpdmJ34Bmk4FmKO5HlGen5bIAzhZqAQylenpJ7_85ZNW-tfMBrtX5dNifLzg9qKz4HDOyxWOxuVA4Tc996oHqqYYeK8DZho_hK92ett81rJJ3pmHidzYBDzAXuAqnUY0__1XlKsU871-sBzdrj8JiETRmBx_OUIVSIuhEghLwqhEq0 Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:40:28.865762 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: a58cd041c02d46dcb8acf6adb11ee9de Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance d111c647-dca9-45d6-96c6-13169658cac9 could not be found. Oct 06 04:40:28.867470 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'd111c647-dca9-45d6-96c6-13169658cac9'} Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d111c647-dca9-45d6-96c6-13169658cac9 could not be found. Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:40:28.868309 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d111c647-dca9-45d6-96c6-13169658cac9 could not be found. Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d111c647-dca9-45d6-96c6-13169658cac9 could not be found. Oct 06 04:40:28.869790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:40:28.870848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Returning 404 to user: Instance d111c647-dca9-45d6-96c6-13169658cac9 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:40:28.870848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c5e72c71-551a-4354-8662-e53ca6f95324 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9" status: 404 len: 111 microversion: 2.1 time: 0.031881 Oct 06 04:40:28.870848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 489/977] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:28 2022] GET /compute/v2.1/servers/d111c647-dca9-45d6-96c6-13169658cac9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:40:28.876664 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:28.877162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:28.883101 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:28.883592 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:28.884027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:28.884717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:28.885171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:28.885596 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:28.913328 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:40:28.991545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-477e42c9-0be6-43e5-a2f6-ca0d8a3c1f9d tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 204 len: 0 microversion: 2.1 time: 0.118478 Oct 06 04:40:28.992444 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 489/978] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:40:28 2022] DELETE /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:40:29.001224 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:29.001905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:29.009744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:29.010241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:29.010930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:29.011745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:29.012440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:29.013148 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:29.152612 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:29.160620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3f6a7ee7-d6a4-4080-880f-bbffa68f20a8 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.163782 Oct 06 04:40:29.161201 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 490/979] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:28 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:29.309142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:29.310059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:29.316495 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:29.316991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:29.317430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:29.318129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:29.319741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:29.320301 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:29.544559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:29.552460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b56b7778-857a-4a73-b809-9665a653cf27 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.247536 Oct 06 04:40:29.567357 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 490/980] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:29 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:29.739557 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-da7ee6b5-da30-45d8-b611-8f99cbf14c21 req-e4a05cf2-16a8-4aca-9f8d-cbdda5bea489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e74e585-b622-4beb-bc2c-f71b2be5e2f7", "tag": "f7c2a9af-8931-4eb7-ae06-a2e1d0566270"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:29.750608 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-da7ee6b5-da30-45d8-b611-8f99cbf14c21 req-e4a05cf2-16a8-4aca-9f8d-cbdda5bea489 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:29.751147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-da7ee6b5-da30-45d8-b611-8f99cbf14c21 req-e4a05cf2-16a8-4aca-9f8d-cbdda5bea489 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:29.751574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-da7ee6b5-da30-45d8-b611-8f99cbf14c21 req-e4a05cf2-16a8-4aca-9f8d-cbdda5bea489 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:29.764575 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-da7ee6b5-da30-45d8-b611-8f99cbf14c21 req-e4a05cf2-16a8-4aca-9f8d-cbdda5bea489 service nova] Creating event network-changed:f7c2a9af-8931-4eb7-ae06-a2e1d0566270 for instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 on hv-cinder-86022 Oct 06 04:40:29.769411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-da7ee6b5-da30-45d8-b611-8f99cbf14c21 req-e4a05cf2-16a8-4aca-9f8d-cbdda5bea489 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033421 Oct 06 04:40:29.770734 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 491/981] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:30.184853 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:30.185545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:30.197635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:30.197635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:30.197635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:30.197635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:30.198938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:30.199453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:30.429031 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:30.436687 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8edea630-2196-4c46-9308-d909d74885a2 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1523 microversion: 2.1 time: 0.255919 Oct 06 04:40:30.437262 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 491/982] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:30 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:30.576688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:30.577389 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:30.584362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:30.584858 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:30.585333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:30.586038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:30.586504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:30.586930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:30.744903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:30.754537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ea9383c8-87e8-41da-9099-540f9f777aa4 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.180613 Oct 06 04:40:30.755550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 492/983] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:30 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:31.462507 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:31.463154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:31.469266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:31.469757 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:31.470196 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:31.470894 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:31.471379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:31.471809 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:31.502925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:31.503443 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:31.503881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:31.504326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lazy-loading 'fault' on Instance uuid 7b1de82b-ccd4-4783-8f2b-8db183ab18ae {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:40:31.546043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:31.553801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3d5ed8f7-2d11-43f2-9e94-7ddeb14d1eba tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1312 microversion: 2.1 time: 0.095674 Oct 06 04:40:31.554375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 492/984] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:31 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:31.778620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:31.779261 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:31.785282 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-36324736-22fa-4f58-b281-b6b5138719ce req-e4edf762-e01f-450e-9e6f-f97c8d8da111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1de82b-ccd4-4783-8f2b-8db183ab18ae", "name": "network-vif-deleted", "tag": "32169a85-ede4-4200-8d87-9cc5853244e1"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:31.785774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:31.786258 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:31.786691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:31.787421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:31.787871 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:31.788297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:31.795050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-36324736-22fa-4f58-b281-b6b5138719ce req-e4edf762-e01f-450e-9e6f-f97c8d8da111 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:31.795529 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-36324736-22fa-4f58-b281-b6b5138719ce req-e4edf762-e01f-450e-9e6f-f97c8d8da111 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:31.795958 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-36324736-22fa-4f58-b281-b6b5138719ce req-e4edf762-e01f-450e-9e6f-f97c8d8da111 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:31.806994 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-36324736-22fa-4f58-b281-b6b5138719ce req-e4edf762-e01f-450e-9e6f-f97c8d8da111 service nova] Creating event network-vif-deleted:32169a85-ede4-4200-8d87-9cc5853244e1 for instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae on hv-cinder-86022 Oct 06 04:40:31.811770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-36324736-22fa-4f58-b281-b6b5138719ce req-e4edf762-e01f-450e-9e6f-f97c8d8da111 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030158 Oct 06 04:40:31.812353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 493/985] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:40:31.923857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:31.932061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-433ec70a-c07e-4cae-888b-18fc093c15c7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.157222 Oct 06 04:40:31.932618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 493/986] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:31 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:32.578631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:32.579391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:32.586319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:32.586807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:32.587279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:32.587976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:32.588468 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:32.588898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:32.618606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:32.619359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:32.619787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:32.620222 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lazy-loading 'fault' on Instance uuid 7b1de82b-ccd4-4783-8f2b-8db183ab18ae {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:40:32.664741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:32.673814 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-469f6038-4dba-4f07-9948-992609f49cdb tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1312 microversion: 2.1 time: 0.098560 Oct 06 04:40:32.673814 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 494/987] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:32 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:32.955589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:32.956200 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:32.962751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:32.963275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:32.963712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:32.964407 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:32.964867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:32.965295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:33.095424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:33.103678 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5cb32d81-279b-41e7-ba28-22893aed87d6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.152033 Oct 06 04:40:33.104237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 494/988] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:32 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:33.697237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:33.697856 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:33.704414 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:33.704900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:33.705342 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:33.706038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:33.706527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:33.706982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:33.737926 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:33.738413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:33.738851 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:33.739326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lazy-loading 'fault' on Instance uuid 7b1de82b-ccd4-4783-8f2b-8db183ab18ae {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:40:33.783443 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a58cd041c02d46dcb8acf6adb11ee9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d643fb7b9314f0a9bb8f2c37f06bb2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:33.791641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c90ae0ef-6083-4cc0-b935-71c7b311e717 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 200 len: 1312 microversion: 2.1 time: 0.099575 Oct 06 04:40:33.792202 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 495/989] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:33 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:34.125822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:34.126434 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:34.133189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:34.133671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:34.134106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:34.134800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:34.135288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:34.135715 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:34.418808 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:34.426389 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c0c391b0-be64-4269-b326-f47db20b7780 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.304398 Oct 06 04:40:34.426948 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 495/990] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:34 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:34.814440 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:34.814981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] [instance: 7b1de82b-ccd4-4783-8f2b-8db183ab18ae] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:34.821894 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:34.822379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:34.822818 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:34.823535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:34.823992 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:34.824417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:34.838217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] HTTP exception thrown: Instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae could not be found. Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Request method failure captured: Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae HTTP/1.1 Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpdmJ34Bmk4FmKO5HlGen5bIAzhZqAQylenpJ7_85ZNW-tfMBrtX5dNifLzg9qKz4HDOyxWOxuVA4Tc996oHqqYYeK8DZho_hK92ett81rJJ3pmHidzYBDzAXuAqnUY0__1XlKsU871-sBzdrj8JiETRmBx_OUIVSIuhEghLwqhEq0 Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:40:34.839840 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d643fb7b9314f0a9bb8f2c37f06bb2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 0d643fb7b9314f0a9bb8f2c37f06bb2d Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-572105831 Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: a58cd041c02d46dcb8acf6adb11ee9de Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-ServerRescueNegativeTestJSON-572105831-project Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae could not be found. Oct 06 04:40:34.841453 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '7b1de82b-ccd4-4783-8f2b-8db183ab18ae'} Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae could not be found. Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:40:34.842337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae could not be found. Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae could not be found. Oct 06 04:40:34.843807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:34.845249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] Returning 404 to user: Instance 7b1de82b-ccd4-4783-8f2b-8db183ab18ae could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:40:34.845249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3712d16b-9492-4b2a-bbf2-7a4ec999cb36 tempest-ServerRescueNegativeTestJSON-572105831 tempest-ServerRescueNegativeTestJSON-572105831-project] 10.222.0.33 "GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae" status: 404 len: 111 microversion: 2.1 time: 0.030755 Oct 06 04:40:34.845249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 496/991] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:34 2022] GET /compute/v2.1/servers/7b1de82b-ccd4-4783-8f2b-8db183ab18ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:40:35.449198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:35.449824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:35.456159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:35.456646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:35.457081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:35.457785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:35.458241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:35.459393 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:35.588986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:35.597077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-179f8f20-b88f-4cc5-af45-3dce662b538a tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.151650 Oct 06 04:40:35.597653 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 496/992] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:35 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:36.622190 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:36.623585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:36.631435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:36.632411 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:36.634728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:36.635376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:36.636187 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:36.637271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:36.638238 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:36.638847 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:36.801916 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:36.810848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6d545725-4c4e-42bc-aa1f-febbbc92555b tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.193380 Oct 06 04:40:36.811633 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 497/993] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:36 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:37.585089 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:37.585641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:37.587613 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=6 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:37.593775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:37.594473 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:37.594920 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:37.595668 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:37.596418 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:37.596970 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:37.625453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-44e13f78-4711-4b9e-9acb-4ed1627552b6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/ips" status: 200 len: 148 microversion: 2.1 time: 0.044231 Oct 06 04:40:37.626479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 497/994] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:40:37 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:37.834729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:37.835621 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:37.843609 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:37.844417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:37.845020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:37.846206 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:37.846813 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:37.847410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:38.026634 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:38.040925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a39ab5ca-74e6-4c54-978e-52cf03963cb0 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.210417 Oct 06 04:40:38.054232 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 498/995] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:37 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:38.288050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-67309330-c218-4f7f-a603-7e2c95021a55 req-79f26982-3329-484f-b6d2-5df54307328a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e74e585-b622-4beb-bc2c-f71b2be5e2f7", "name": "network-vif-plugged", "status": "completed", "tag": "f7c2a9af-8931-4eb7-ae06-a2e1d0566270"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:38.298400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-67309330-c218-4f7f-a603-7e2c95021a55 req-79f26982-3329-484f-b6d2-5df54307328a service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:38.298919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-67309330-c218-4f7f-a603-7e2c95021a55 req-79f26982-3329-484f-b6d2-5df54307328a service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:38.299358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-67309330-c218-4f7f-a603-7e2c95021a55 req-79f26982-3329-484f-b6d2-5df54307328a service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:38.312067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-67309330-c218-4f7f-a603-7e2c95021a55 req-79f26982-3329-484f-b6d2-5df54307328a service nova] Creating event network-vif-plugged:f7c2a9af-8931-4eb7-ae06-a2e1d0566270 for instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 on hv-cinder-86022 Oct 06 04:40:38.317792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-67309330-c218-4f7f-a603-7e2c95021a55 req-79f26982-3329-484f-b6d2-5df54307328a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034746 Oct 06 04:40:38.320018 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 498/996] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:39.051551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2909691-bf8f-41b9-a62f-1dd8d9bfe9de"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:39.055157 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:39.061679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:39.062357 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:39.062800 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:39.064176 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:39.064820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:39.065415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:39.067938 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:39.069469 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:39.076562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:39.077150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:39.077667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:39.078538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:39.079314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:39.079754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:39.234191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:39.242978 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0528e4f4-b002-4358-a2d4-61cd276fbf70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1361 microversion: 2.1 time: 0.180776 Oct 06 04:40:39.243677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 499/997] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:39 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:39.829129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5fd23cd2-14a4-4316-b069-b646dba1a7da tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781482 Oct 06 04:40:39.834999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 499/998] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:40:39 2022] POST /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:40.269293 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:40.269903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:40.277057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:40.277534 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:40.277984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:40.278663 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:40.279141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:40.279564 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:40.425948 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:40.434609 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-48a44dae-2b30-4ea6-a29e-04624f834cf5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1546 microversion: 2.1 time: 0.168910 Oct 06 04:40:40.435068 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 500/999] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:40 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:40.457955 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:40.458700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:40.466096 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:40.466585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:40.467073 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:40.467858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:40.468326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:40.468776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:40.553704 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5cffa66c-5692-44c7-8715-c52ca08d0b06 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100525 Oct 06 04:40:40.554294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 500/1000] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 04:40:40 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:41.624887 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-b9441d2b-a275-4138-9cfe-0d3cfa84e1d7 req-78ed764d-20b4-460c-83b3-3935734056c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e74e585-b622-4beb-bc2c-f71b2be5e2f7", "tag": "f7c2a9af-8931-4eb7-ae06-a2e1d0566270"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:41.641633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b9441d2b-a275-4138-9cfe-0d3cfa84e1d7 req-78ed764d-20b4-460c-83b3-3935734056c4 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:41.643670 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b9441d2b-a275-4138-9cfe-0d3cfa84e1d7 req-78ed764d-20b4-460c-83b3-3935734056c4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:41.644338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b9441d2b-a275-4138-9cfe-0d3cfa84e1d7 req-78ed764d-20b4-460c-83b3-3935734056c4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:41.663643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-b9441d2b-a275-4138-9cfe-0d3cfa84e1d7 req-78ed764d-20b4-460c-83b3-3935734056c4 service nova] Creating event network-changed:f7c2a9af-8931-4eb7-ae06-a2e1d0566270 for instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 on hv-cinder-86022 Oct 06 04:40:41.670082 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-b9441d2b-a275-4138-9cfe-0d3cfa84e1d7 req-78ed764d-20b4-460c-83b3-3935734056c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050341 Oct 06 04:40:41.671237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 501/1001] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:48.473096 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2909691-bf8f-41b9-a62f-1dd8d9bfe9de"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:48.475471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:48.477410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:48.482770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:48.483278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:48.483711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:48.484395 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:48.484839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:48.485272 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:48.564619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Invalid volume: volume c2909691-bf8f-41b9-a62f-1dd8d9bfe9de is already attached to instances: fa90860d-54c2-4079-9291-a9bd449aa9da Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: POST /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments HTTP/1.1 Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 74 Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:40:48.566559 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {"volumeAttachment": {"volumeId": "c2909691-bf8f-41b9-a62f-1dd8d9bfe9de"}} Oct 06 04:40:48.568848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Invalid volume: volume c2909691-bf8f-41b9-a62f-1dd8d9bfe9de is already attached to instances: fa90860d-54c2-4079-9291-a9bd449aa9da Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'server_id': 'fa90860d-54c2-4079-9291-a9bd449aa9da', 'body': {'volumeAttachment': {'volumeId': 'c2909691-bf8f-41b9-a62f-1dd8d9bfe9de'}}} Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2909691-bf8f-41b9-a62f-1dd8d9bfe9de is already attached to instances: fa90860d-54c2-4079-9291-a9bd449aa9da Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:48.569790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2909691-bf8f-41b9-a62f-1dd8d9bfe9de is already attached to instances: fa90860d-54c2-4079-9291-a9bd449aa9da Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:48.571320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:48.573271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:48.573271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:40:48.573271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:40:48.573271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2909691-bf8f-41b9-a62f-1dd8d9bfe9de is already attached to instances: fa90860d-54c2-4079-9291-a9bd449aa9da Oct 06 04:40:48.573271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:48.573271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 400 to user: Invalid volume: volume c2909691-bf8f-41b9-a62f-1dd8d9bfe9de is already attached to instances: fa90860d-54c2-4079-9291-a9bd449aa9da {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:40:48.573271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-77b6dea9-9ed8-4284-8c35-42307034ecf4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100367 Oct 06 04:40:48.573271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 501/1002] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:40:48 2022] POST /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:40:48.637725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:48.638337 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:48.640392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:48.646424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:48.646906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:48.647433 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:48.648124 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:48.648618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:48.649042 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:48.653554 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=100 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:48.732924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'services' on Instance uuid fa90860d-54c2-4079-9291-a9bd449aa9da {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:40:48.802635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3a72158c-c6ea-4a2c-b61a-a3dbe86f9e66 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments/c2909691-bf8f-41b9-a62f-1dd8d9bfe9de" status: 202 len: 0 microversion: 2.1 time: 0.169153 Oct 06 04:40:48.803430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 502/1003] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:40:48 2022] DELETE /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments/c2909691-bf8f-41b9-a62f-1dd8d9bfe9de => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:40:48.811903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:48.814101 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:48.822657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:48.823183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:48.823618 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:48.824317 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:48.824771 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:48.825194 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:48.841412 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:40:48.857839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c59d5d61-18e5-469e-a24e-3eff440b90d4 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050063 Oct 06 04:40:48.858413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 502/1004] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:40:48 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:49.871306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:49.873753 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:49.879878 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:49.880854 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:49.881281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:49.881964 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:49.882443 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:49.882861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:49.914514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1c9290ae-d6ef-4ebc-8a72-48faa5061618 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048319 Oct 06 04:40:49.915125 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 503/1005] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:40:49 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:40:49.980022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:49.980533 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:49.987205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:49.987685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:49.988118 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:49.988806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:49.989829 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:49.990338 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:50.017166 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:40:50.103054 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4e731307-eed1-43da-9d9f-df1d7503d6a7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 204 len: 0 microversion: 2.1 time: 0.125860 Oct 06 04:40:50.103744 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 503/1006] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:40:49 2022] DELETE /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:40:50.111818 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:50.112586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:50.118630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:50.119525 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:50.120153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:50.121028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:50.121482 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:50.121922 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:50.255027 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:50.262829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ab2c8e9c-8789-461f-979f-3e4553f7a36c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1678 microversion: 2.1 time: 0.154821 Oct 06 04:40:50.263421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 504/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:50 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:40:51.287577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:51.288931 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:51.295149 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:51.295724 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:51.296069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:51.296763 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:51.297212 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:51.297816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:51.435824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:51.443639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c1091246-ba12-4ea8-bcb2-318ba5ce806e tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1678 microversion: 2.1 time: 0.160613 Oct 06 04:40:51.444202 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 504/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:51 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:52.468296 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:52.468958 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:52.475769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:52.476258 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:52.476696 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:52.477406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:52.478040 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:52.478487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:52.607602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:52.615962 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-765e00b5-6c91-46b7-acf7-6052defae025 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1678 microversion: 2.1 time: 0.152404 Oct 06 04:40:52.616735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 505/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:52 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:53.294105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-85bba5e6-c92c-44a4-9fa3-d71e4c64c816 req-6e6297bc-7bd6-433e-88e6-93676090168c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa90860d-54c2-4079-9291-a9bd449aa9da", "name": "network-vif-deleted", "tag": "2659587a-fc4a-47ce-a346-515fe41fc5ad"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:53.310053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-85bba5e6-c92c-44a4-9fa3-d71e4c64c816 req-6e6297bc-7bd6-433e-88e6-93676090168c service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:53.310912 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-85bba5e6-c92c-44a4-9fa3-d71e4c64c816 req-6e6297bc-7bd6-433e-88e6-93676090168c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:53.311351 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-85bba5e6-c92c-44a4-9fa3-d71e4c64c816 req-6e6297bc-7bd6-433e-88e6-93676090168c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:53.325793 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-85bba5e6-c92c-44a4-9fa3-d71e4c64c816 req-6e6297bc-7bd6-433e-88e6-93676090168c service nova] Creating event network-vif-deleted:2659587a-fc4a-47ce-a346-515fe41fc5ad for instance fa90860d-54c2-4079-9291-a9bd449aa9da on hv-cinder-86022 Oct 06 04:40:53.331767 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-85bba5e6-c92c-44a4-9fa3-d71e4c64c816 req-6e6297bc-7bd6-433e-88e6-93676090168c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041843 Oct 06 04:40:53.332448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 505/1010] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:53.646895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:53.647696 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:53.655873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:53.657271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:53.657966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:53.659004 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:53.659634 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:53.660069 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:53.712024 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:53.712537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:53.712965 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:53.713414 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'fault' on Instance uuid fa90860d-54c2-4079-9291-a9bd449aa9da {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:40:53.767338 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:53.776217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a18525f2-706c-48ee-a7b3-206a27143bef tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 200 len: 1329 microversion: 2.1 time: 0.138197 Oct 06 04:40:53.776754 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 506/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:53 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 1329 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:54.804881 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:54.805597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:54.811678 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:54.812153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:54.812581 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:54.813261 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:54.813709 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:54.814125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:54.828242 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da HTTP/1.1 Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:40:54.829868 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:40:54.831486 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': 'fa90860d-54c2-4079-9291-a9bd449aa9da'} Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:40:54.832390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:40:54.833918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:40:54.835277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:40:54.835277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d82e6209-5919-496f-9c67-936ee4cedc78 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 404 len: 111 microversion: 2.1 time: 0.031629 Oct 06 04:40:54.835277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 506/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:54 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:40:54.840135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-43a21792-1e1d-43d4-961b-25baebb60784 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '.version_select at 0x7f0c42e35af0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:54.862139 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-43a21792-1e1d-43d4-961b-25baebb60784 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655066248" status: 202 len: 0 microversion: 2.1 time: 0.025712 Oct 06 04:40:54.862713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 507/1013] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Oct 6 04:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655066248 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:40:55.498942 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-77aab435-77c4-4f0a-805e-b3a32672a165 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: .version_select at 0x7f0c42ba5dc0>, body: {"keypair": {"name": "tempest-keypair-1486238852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOo1iSsY6skKNUIC+Uc6+0ImsyDXPfhOCT57h1Caw4M+m8BVFtnK9Cj+fdNu62YKp4f9s3NkSkX6bnLSlCPTsxj7GY1NiN8hVrOYLgofN9LTfDy0WKRIvtipZDWuIHXHQ=="}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:55.514898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-77aab435-77c4-4f0a-805e-b3a32672a165 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:40:55.518788 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-77aab435-77c4-4f0a-805e-b3a32672a165 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for user f68d73b5efc74b3380429cf72e506905 and project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'key_pairs'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:40:55.540284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-77aab435-77c4-4f0a-805e-b3a32672a165 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045208 Oct 06 04:40:55.540878 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 507/1014] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:40:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:40:56.829838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-324888144", "imageRef": "e8cc06fd-44d8-4325-8962-e3c16d624358", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45c9d327-544f-44d6-be7e-529008b00a93"}], "security_groups": [{"name": "tempest-securitygroup--1333094147"}], "key_name": "tempest-keypair-1486238852", "user_data": "}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:40:56.934214 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] validate_networks() for [('45c9d327-544f-44d6-be7e-529008b00a93', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:40:57.303804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:40:57.304229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:40:57.304732 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:40:57.305144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:40:57.305558 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:40:57.314231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:57.314734 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:57.315198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:57.315930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:57.316393 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:57.316822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:57.334073 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:40:57.338041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Getting quotas for user f68d73b5efc74b3380429cf72e506905 and project 653e21693b6f4a3ca8b739f1290df3aa. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:40:57.349346 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:40:57.351672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8cc06fd-44d8-4325-8962-e3c16d624358',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:40:57.398725 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-272b0bd0-625e-4a3d-8f71-bae6f012eaad tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.574119 Oct 06 04:40:57.399403 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 508/1015] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:40:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:40:57.410390 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ffdc3d1b-485e-4160-b4ef-3de04e287f68 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:57.411860 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ffdc3d1b-485e-4160-b4ef-3de04e287f68 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:57.479664 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ffdc3d1b-485e-4160-b4ef-3de04e287f68 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:57.487988 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ffdc3d1b-485e-4160-b4ef-3de04e287f68 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1241 microversion: 2.1 time: 0.081416 Oct 06 04:40:57.488562 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 508/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:57 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:58.512101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:58.513533 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:58.522428 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:58.523064 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:58.523817 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:58.524652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:58.525106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:58.525534 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:58.621781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:58.632610 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-34d89c03-7afe-4479-a251-9f630f438995 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1301 microversion: 2.1 time: 0.124679 Oct 06 04:40:58.636234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 509/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:58 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1301 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:40:59.659167 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:40:59.659869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:40:59.666862 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:59.667628 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:59.668392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:59.669274 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:40:59.669876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:40:59.670459 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:40:59.897450 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:40:59.906226 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fba7238b-dd9a-47bf-a35d-42a7179f3c4c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1367 microversion: 2.1 time: 0.251083 Oct 06 04:40:59.907059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 509/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:40:59 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:00.307036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-4d5c75ae-735a-46a3-8f8a-90b73d2119dd req-b422c3f9-1d67-4e21-b9e1-666657194355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1058bc0-f3b2-48bf-b41e-004403add62f", "tag": "439785b6-0b32-4a32-8348-4a5f35fd1657"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:41:00.318265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-4d5c75ae-735a-46a3-8f8a-90b73d2119dd req-b422c3f9-1d67-4e21-b9e1-666657194355 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:00.319199 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-4d5c75ae-735a-46a3-8f8a-90b73d2119dd req-b422c3f9-1d67-4e21-b9e1-666657194355 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:00.319863 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-4d5c75ae-735a-46a3-8f8a-90b73d2119dd req-b422c3f9-1d67-4e21-b9e1-666657194355 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:00.335043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-4d5c75ae-735a-46a3-8f8a-90b73d2119dd req-b422c3f9-1d67-4e21-b9e1-666657194355 service nova] Creating event network-changed:439785b6-0b32-4a32-8348-4a5f35fd1657 for instance c1058bc0-f3b2-48bf-b41e-004403add62f on hv-cinder-86022 Oct 06 04:41:00.340219 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-4d5c75ae-735a-46a3-8f8a-90b73d2119dd req-b422c3f9-1d67-4e21-b9e1-666657194355 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036820 Oct 06 04:41:00.341188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 510/1019] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:41:00.930768 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:00.931475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:00.938199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:00.938901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:00.939373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:00.940067 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:00.940523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:00.940945 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:01.081518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:01.092032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f4fe7728-de30-4014-a6e3-9d5f7e2e0b98 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1367 microversion: 2.1 time: 0.165954 Oct 06 04:41:01.092962 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 510/1020] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:00 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:02.116595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:02.117291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:02.123805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:02.124292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:02.124731 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:02.125419 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:02.125873 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:02.126297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:02.254935 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:02.268136 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-416c3367-e4d8-41c9-a80a-816c031c104b tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1367 microversion: 2.1 time: 0.156101 Oct 06 04:41:02.268718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 511/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:02 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:03.292074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:03.292677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:03.298983 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:03.299489 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:03.299919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:03.300608 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:03.301053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:03.302139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:03.557048 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:03.565222 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b841142d-4e29-4a42-8fcf-caa668b0968a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1367 microversion: 2.1 time: 0.276975 Oct 06 04:41:03.565871 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 511/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:03 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:04.589019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:04.589642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:04.596114 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:04.596602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:04.597044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:04.597744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:04.598724 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:04.600341 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:04.980009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:04.989609 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6370063c-74a8-4a6f-8667-69e2ffaa999c tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1367 microversion: 2.1 time: 0.403957 Oct 06 04:41:04.990178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 512/1023] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:04 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:06.020648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:06.022050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:06.028530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:06.029012 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:06.029448 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:06.030148 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:06.030593 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:06.031074 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:06.176423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-0f8d491a-642c-417f-a482-1fb9dcb2cb8d req-d61113c2-e522-406f-b030-3b13a22f6db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1058bc0-f3b2-48bf-b41e-004403add62f", "name": "network-vif-plugged", "status": "completed", "tag": "439785b6-0b32-4a32-8348-4a5f35fd1657"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:41:06.184816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:06.191340 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-0f8d491a-642c-417f-a482-1fb9dcb2cb8d req-d61113c2-e522-406f-b030-3b13a22f6db2 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:06.193112 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-0f8d491a-642c-417f-a482-1fb9dcb2cb8d req-d61113c2-e522-406f-b030-3b13a22f6db2 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:06.193580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-01e9bf22-dbd9-431d-92f1-3abb27cb7b0d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1367 microversion: 2.1 time: 0.181363 Oct 06 04:41:06.194102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-0f8d491a-642c-417f-a482-1fb9dcb2cb8d req-d61113c2-e522-406f-b030-3b13a22f6db2 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:06.203444 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 512/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:06 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:06.210300 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-0f8d491a-642c-417f-a482-1fb9dcb2cb8d req-d61113c2-e522-406f-b030-3b13a22f6db2 service nova] Creating event network-vif-plugged:439785b6-0b32-4a32-8348-4a5f35fd1657 for instance c1058bc0-f3b2-48bf-b41e-004403add62f on hv-cinder-86022 Oct 06 04:41:06.215744 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-0f8d491a-642c-417f-a482-1fb9dcb2cb8d req-d61113c2-e522-406f-b030-3b13a22f6db2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046514 Oct 06 04:41:06.216650 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 513/1025] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:41:07.217389 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:07.217991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:07.225130 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:07.225611 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:07.226039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:07.226728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:07.227203 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:07.227627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:07.364601 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:07.372469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b9074a9a-1474-43e2-a510-3958cd20e287 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1367 microversion: 2.1 time: 0.158907 Oct 06 04:41:07.373030 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 513/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:07 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:08.396403 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:08.397279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:08.399804 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:08.400604 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=6 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:08.406566 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:08.407077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:08.407513 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:08.408209 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:08.408697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:08.409127 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:08.548279 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:08.556404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-746d62e2-3c39-4d65-82e7-6708c23046e1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1555 microversion: 2.1 time: 0.164788 Oct 06 04:41:08.556983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 514/1027] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:08 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:08.583379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:08.584005 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:08.588749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:08.591513 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:08.591994 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:08.592425 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:08.593125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:08.593568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:08.593985 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:08.698071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-52216fc8-4807-46d3-b2a1-4d8d446caa74 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120096 Oct 06 04:41:08.698669 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 514/1028] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Oct 6 04:41:08 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:41:09.930318 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-2308e9ae-62cd-4589-98ba-e1bd9791e060 req-f7f4deaa-7ef9-4cfb-a118-8f7beb4e537f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1058bc0-f3b2-48bf-b41e-004403add62f", "tag": "439785b6-0b32-4a32-8348-4a5f35fd1657"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:41:09.940620 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-2308e9ae-62cd-4589-98ba-e1bd9791e060 req-f7f4deaa-7ef9-4cfb-a118-8f7beb4e537f service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:09.941175 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-2308e9ae-62cd-4589-98ba-e1bd9791e060 req-f7f4deaa-7ef9-4cfb-a118-8f7beb4e537f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:09.941704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-2308e9ae-62cd-4589-98ba-e1bd9791e060 req-f7f4deaa-7ef9-4cfb-a118-8f7beb4e537f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:09.953662 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-2308e9ae-62cd-4589-98ba-e1bd9791e060 req-f7f4deaa-7ef9-4cfb-a118-8f7beb4e537f service nova] Creating event network-changed:439785b6-0b32-4a32-8348-4a5f35fd1657 for instance c1058bc0-f3b2-48bf-b41e-004403add62f on hv-cinder-86022 Oct 06 04:41:09.959515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-2308e9ae-62cd-4589-98ba-e1bd9791e060 req-f7f4deaa-7ef9-4cfb-a118-8f7beb4e537f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034839 Oct 06 04:41:09.960473 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 515/1029] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:41:26.748937 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:26.749752 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:26.754382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-222853315"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:41:26.755101 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:26.763188 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:26.763762 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:26.764387 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:26.765211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:26.765670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:26.766100 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:26.897253 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.network.security_group_api [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Removing security group 7834e0cd-d634-4aca-be75-3780d2f38a10 from port 45ae6e2d-fb0b-43fb-856e-042caa9bfd4d Oct 06 04:41:27.217263 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-18541e2e-6393-4377-89c2-fb1f7557bb4d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "POST /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/action" status: 202 len: 0 microversion: 2.1 time: 0.469447 Oct 06 04:41:27.217898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 515/1030] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:41:26 2022] POST /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:41:27.224245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:27.225505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:27.230358 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-bfd3748f-bd3b-44ab-9820-798f345b357a req-3faf55bf-37fe-42bc-aa35-ac2aea0ddab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee803bb5-a84c-4e42-a010-76f9cfba5933", "tag": "45ae6e2d-fb0b-43fb-856e-042caa9bfd4d"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:41:27.243324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-bfd3748f-bd3b-44ab-9820-798f345b357a req-3faf55bf-37fe-42bc-aa35-ac2aea0ddab9 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:27.244283 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-bfd3748f-bd3b-44ab-9820-798f345b357a req-3faf55bf-37fe-42bc-aa35-ac2aea0ddab9 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:27.244910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-bfd3748f-bd3b-44ab-9820-798f345b357a req-3faf55bf-37fe-42bc-aa35-ac2aea0ddab9 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:27.257844 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-bfd3748f-bd3b-44ab-9820-798f345b357a req-3faf55bf-37fe-42bc-aa35-ac2aea0ddab9 service nova] Creating event network-changed:45ae6e2d-fb0b-43fb-856e-042caa9bfd4d for instance ee803bb5-a84c-4e42-a010-76f9cfba5933 on hv-cinder-86022 Oct 06 04:41:27.263927 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-bfd3748f-bd3b-44ab-9820-798f345b357a req-3faf55bf-37fe-42bc-aa35-ac2aea0ddab9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041043 Oct 06 04:41:27.264721 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 516/1031] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:41:28.876815 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:28.879889 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:28.884582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:28.885187 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:28.885725 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:28.887742 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:28.888312 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:28.889417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:28.975704 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lazy-loading 'services' on Instance uuid ee803bb5-a84c-4e42-a010-76f9cfba5933 {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:41:29.060941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c4ff10e1-44f7-46c3-8d8c-567b038a62f2 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments/30fb6b08-8040-46c8-8e80-07bd4ca93b49" status: 202 len: 0 microversion: 2.1 time: 0.188254 Oct 06 04:41:29.061656 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 516/1032] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:41:28 2022] DELETE /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments/30fb6b08-8040-46c8-8e80-07bd4ca93b49 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:41:29.071980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:29.075997 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:29.082778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:29.083373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:29.084069 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:29.084985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:29.085459 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:29.085885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:29.119221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-687d8d89-6139-48cd-a67d-b3e818069553 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052391 Oct 06 04:41:29.119705 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 517/1033] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:41:29 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:41:29.282583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-0433c896-bf5d-48a0-bcaf-0a85c676c4e9 req-4f4d62eb-e784-485f-9db3-59d4da68e1fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee803bb5-a84c-4e42-a010-76f9cfba5933", "tag": "45ae6e2d-fb0b-43fb-856e-042caa9bfd4d"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:41:29.292290 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0433c896-bf5d-48a0-bcaf-0a85c676c4e9 req-4f4d62eb-e784-485f-9db3-59d4da68e1fb service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:29.292780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0433c896-bf5d-48a0-bcaf-0a85c676c4e9 req-4f4d62eb-e784-485f-9db3-59d4da68e1fb service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:29.293205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-0433c896-bf5d-48a0-bcaf-0a85c676c4e9 req-4f4d62eb-e784-485f-9db3-59d4da68e1fb service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:29.303937 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-0433c896-bf5d-48a0-bcaf-0a85c676c4e9 req-4f4d62eb-e784-485f-9db3-59d4da68e1fb service nova] Creating event network-changed:45ae6e2d-fb0b-43fb-856e-042caa9bfd4d for instance ee803bb5-a84c-4e42-a010-76f9cfba5933 on hv-cinder-86022 Oct 06 04:41:29.309134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-0433c896-bf5d-48a0-bcaf-0a85c676c4e9 req-4f4d62eb-e784-485f-9db3-59d4da68e1fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031277 Oct 06 04:41:29.309729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 517/1034] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:41:30.133508 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:30.135930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:30.144871 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:30.145526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:30.146027 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:30.147008 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:30.147444 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:30.147858 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:30.181448 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b6024273-caf7-4303-b4ec-6e08c34d33cf tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052944 Oct 06 04:41:30.182161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 518/1035] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:41:30 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:41:31.195708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:31.198043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:31.205276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:31.205765 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:31.206205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:31.206901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:31.207383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:31.207811 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:31.237025 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-46b6b0a1-284c-49ab-ae17-d4f62e228beb tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046112 Oct 06 04:41:31.237586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 518/1036] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:41:31 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:41:31.249324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:31.249820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:31.256245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:31.256735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:31.257170 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:31.257871 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:31.258331 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:31.258760 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:31.338402 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] HTTP exception thrown: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 is not attached to volume 30fb6b08-8040-46c8-8e80-07bd4ca93b49 Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Request method failure captured: Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: DELETE /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments/30fb6b08-8040-46c8-8e80-07bd4ca93b49 HTTP/1.1 Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPluPnKpcigGTpBF_TepSxZ0-h-5romMiYTLEyyQ91M5HPTGS2S97zbFWbX-01ChgozYq_XbKLd-0yu0t1xVMm6EkdkygE_pFlZJ_OHkmnc3aIFdBFXiiCRVTO09RmONs2AJjzbSJ8XO5-75Jn0EGZkjne6Eb19PuvCIv_Ecr_-7ljsk Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 43ee2f7c65044158a0230e4997d7bdf9 Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-TestMinimumBasicScenario-1689358882 Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:41:31.345361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/43ee2f7c65044158a0230e4997d7bdf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/43ee2f7c65044158a0230e4997d7bdf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_43ee2f7c65044158a0230e4997d7bdf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/43ee2f7c65044158a0230e4997d7bdf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-TestMinimumBasicScenario-1689358882 Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 43ee2f7c65044158a0230e4997d7bdf9 Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1689358882 Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-TestMinimumBasicScenario-1689358882-project Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: ddfa371a39b84f42bba4621ae3a99794 Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-TestMinimumBasicScenario-1689358882-project Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:41:31.346895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 is not attached to volume 30fb6b08-8040-46c8-8e80-07bd4ca93b49 Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'server_id': 'ee803bb5-a84c-4e42-a010-76f9cfba5933', 'id': '30fb6b08-8040-46c8-8e80-07bd4ca93b49'} Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 30fb6b08-8040-46c8-8e80-07bd4ca93b49. Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:41:31.347911 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 is not attached to volume 30fb6b08-8040-46c8-8e80-07bd4ca93b49 Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 is not attached to volume 30fb6b08-8040-46c8-8e80-07bd4ca93b49 Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:41:31.349406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Returning 404 to user: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 is not attached to volume 30fb6b08-8040-46c8-8e80-07bd4ca93b49 {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:41:31.350602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4ae32750-4161-483b-8df7-89e6b1624352 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments/30fb6b08-8040-46c8-8e80-07bd4ca93b49" status: 404 len: 154 microversion: 2.1 time: 0.102691 Oct 06 04:41:31.350602 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 519/1037] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:41:31 2022] DELETE /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933/os-volume_attachments/30fb6b08-8040-46c8-8e80-07bd4ca93b49 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:41:32.490735 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:32.491268 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:32.498667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:32.499190 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:32.499629 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:32.500319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:32.500772 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:32.501197 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:32.526174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:41:32.601927 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6bb44eb8-1ca0-41cd-a05b-de3b643a117a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 204 len: 0 microversion: 2.1 time: 0.114667 Oct 06 04:41:32.602638 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 519/1038] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:41:32 2022] DELETE /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:41:32.612145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:32.612857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:32.619523 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:32.620007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:32.620560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:32.621401 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:32.621860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:32.622286 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:32.764927 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:32.772882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3b29a7c7-a259-433c-aecf-4155b449aaab tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1554 microversion: 2.1 time: 0.164515 Oct 06 04:41:32.773445 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 520/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:32 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:33.796983 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:33.797675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:33.803987 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:33.804466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:33.804898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:33.805583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:33.806028 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:33.806449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:33.935658 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:33.943287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-83bda3f0-3d9f-4a46-afd0-e16a9cb76a6a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1554 microversion: 2.1 time: 0.150522 Oct 06 04:41:33.943851 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 520/1040] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:33 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:34.967987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:34.968532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:34.974947 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:34.975452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:34.975888 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:34.976575 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:34.977026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:34.977445 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:35.105297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:35.112849 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8ec0d66e-13a6-4b44-a066-86aa9aeda675 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1554 microversion: 2.1 time: 0.149626 Oct 06 04:41:35.113406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 521/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:34 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:36.136216 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:36.136854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:36.143277 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:36.143758 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:36.144191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:36.144877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:36.145360 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:36.145784 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:36.282171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:36.289956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2326032a-8f3b-455f-bdd5-b4ca080ab58a tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1554 microversion: 2.1 time: 0.157664 Oct 06 04:41:36.290528 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 521/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:36 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:37.314155 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:37.314798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:37.321325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:37.321811 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:37.322252 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:37.322949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:37.324018 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:37.324534 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:37.453832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:37.461479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-847a4a47-2c00-442c-b8b8-331cae8ba0b6 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1554 microversion: 2.1 time: 0.151019 Oct 06 04:41:37.461889 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 522/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:37 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:38.485757 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:38.486438 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:38.493555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:38.494300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:38.494745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:38.495625 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:38.496185 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:38.496532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:38.687487 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfa371a39b84f42bba4621ae3a99794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ee2f7c65044158a0230e4997d7bdf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:38.695188 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d8c4168c-6e4a-4fa6-9322-813ff6155150 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 200 len: 1554 microversion: 2.1 time: 0.213891 Oct 06 04:41:38.695764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 522/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:38 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:41:38.797937 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-8cc5e36e-3500-46e8-9938-70e19e56c398 req-44910d67-c5c3-4d50-9901-3ed914fe2e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee803bb5-a84c-4e42-a010-76f9cfba5933", "name": "network-vif-deleted", "tag": "45ae6e2d-fb0b-43fb-856e-042caa9bfd4d"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:41:38.807992 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8cc5e36e-3500-46e8-9938-70e19e56c398 req-44910d67-c5c3-4d50-9901-3ed914fe2e0f service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:38.808570 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8cc5e36e-3500-46e8-9938-70e19e56c398 req-44910d67-c5c3-4d50-9901-3ed914fe2e0f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:38.808999 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8cc5e36e-3500-46e8-9938-70e19e56c398 req-44910d67-c5c3-4d50-9901-3ed914fe2e0f service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:38.819893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-8cc5e36e-3500-46e8-9938-70e19e56c398 req-44910d67-c5c3-4d50-9901-3ed914fe2e0f service nova] Creating event network-vif-deleted:45ae6e2d-fb0b-43fb-856e-042caa9bfd4d for instance ee803bb5-a84c-4e42-a010-76f9cfba5933 on hv-cinder-86022 Oct 06 04:41:38.824793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-8cc5e36e-3500-46e8-9938-70e19e56c398 req-44910d67-c5c3-4d50-9901-3ed914fe2e0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Oct 06 04:41:38.825377 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 523/1045] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:41:39.718133 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:39.718739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] [instance: ee803bb5-a84c-4e42-a010-76f9cfba5933] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:39.725317 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:39.725793 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:39.726229 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:39.726910 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:39.727381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:39.727799 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:39.741377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] HTTP exception thrown: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 could not be found. Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Request method failure captured: Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 HTTP/1.1 Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPluPnKpcigGTpBF_TepSxZ0-h-5romMiYTLEyyQ91M5HPTGS2S97zbFWbX-01ChgozYq_XbKLd-0yu0t1xVMm6EkdkygE_pFlZJ_OHkmnc3aIFdBFXiiCRVTO09RmONs2AJjzbSJ8XO5-75Jn0EGZkjne6Eb19PuvCIv_Ecr_-7ljsk Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 43ee2f7c65044158a0230e4997d7bdf9 Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-TestMinimumBasicScenario-1689358882 Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:41:39.743006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/43ee2f7c65044158a0230e4997d7bdf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/43ee2f7c65044158a0230e4997d7bdf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_43ee2f7c65044158a0230e4997d7bdf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/43ee2f7c65044158a0230e4997d7bdf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-TestMinimumBasicScenario-1689358882 Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 43ee2f7c65044158a0230e4997d7bdf9 Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1689358882 Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-TestMinimumBasicScenario-1689358882-project Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: ddfa371a39b84f42bba4621ae3a99794 Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-TestMinimumBasicScenario-1689358882-project Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 could not be found. Oct 06 04:41:39.745027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': 'ee803bb5-a84c-4e42-a010-76f9cfba5933'} Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 could not be found. Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:41:39.746716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 could not be found. Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 could not be found. Oct 06 04:41:39.748239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:41:39.749633 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Returning 404 to user: Instance ee803bb5-a84c-4e42-a010-76f9cfba5933 could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:41:39.749633 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-763a6237-9955-48fe-99e0-11cd7f37af6d tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933" status: 404 len: 111 microversion: 2.1 time: 0.030362 Oct 06 04:41:39.749633 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 523/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:41:39 2022] GET /compute/v2.1/servers/ee803bb5-a84c-4e42-a010-76f9cfba5933 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:41:39.754684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-22f33b8a-3bca-4a6a-8f6d-b48753f85e29 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] Calling method '.version_select at 0x7f0c429ac3a0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:39.773895 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-22f33b8a-3bca-4a6a-8f6d-b48753f85e29 tempest-TestMinimumBasicScenario-1689358882 tempest-TestMinimumBasicScenario-1689358882-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-618934545" status: 202 len: 0 microversion: 2.1 time: 0.023419 Oct 06 04:41:39.774453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 524/1047] 10.222.0.33 () {58 vars in 1269 bytes} [Thu Oct 6 04:41:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-618934545 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:41:39.972820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:39.973319 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:39.979205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:39.980356 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:39.980808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:39.981514 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:39.981982 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:39.982409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:40.007207 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f284bb46-7670-490d-ab61-aac3313db038 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/ips" status: 200 len: 153 microversion: 2.20 time: 0.038042 Oct 06 04:41:40.008153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 524/1048] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Oct 6 04:41:39 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:41:43.991820 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:41:43.992485 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:43.999242 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:43.999735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:44.000182 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:44.000909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:44.001360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:44.001784 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:44.027030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lazy-loading 'flavor' on Instance uuid 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:41:44.231740 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d4fbfc2b-2ee0-4751-99fb-94755d316b9d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/action" status: 202 len: 0 microversion: 2.20 time: 0.244111 Oct 06 04:41:44.237239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 525/1049] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Oct 6 04:41:43 2022] POST /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:41:44.241420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:44.242045 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:44.252309 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:44.252741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:44.253225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:44.253973 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:44.254449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:44.254896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:44.478235 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:44.487731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:44.489228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:44.490638 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-791b17a2-dd5d-4c1e-b834-b559e0b858c3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.253102 Oct 06 04:41:44.491307 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 525/1050] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:44 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:45.524830 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:45.526922 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:45.535416 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:45.535909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:45.536349 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:45.537242 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:45.537709 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:45.538134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:45.778275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:45.786324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:45.787800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:45.788966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c474b27f-1882-4c5a-a410-37a6b6c27e15 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.270630 Oct 06 04:41:45.789522 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 526/1051] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:45 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:41:46.815008 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:46.815909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:46.827553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:46.828052 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:46.828681 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:46.830104 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:46.830707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:46.831021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:47.027295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:47.035419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:47.036877 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:47.038089 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8150e0b0-503c-46da-9f03-ec4023659dbf tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.227068 Oct 06 04:41:47.038585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 526/1052] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:46 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:48.063977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:48.064720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:48.072108 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:48.072601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:48.073142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:48.073893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:48.074855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:48.075317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:48.223621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:48.233080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:48.235435 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:48.237086 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e5aa1184-c517-4151-a3d0-e80c72b2b2d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.177113 Oct 06 04:41:48.237712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 527/1053] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:48 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:49.264527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:49.265135 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:49.271661 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:49.272150 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:49.272579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:49.273271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:49.273726 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:49.274158 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:49.413990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:49.423007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:49.424477 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:49.425670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2a44dca8-094d-4f2f-b4fc-54acdd7d51ac tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.165814 Oct 06 04:41:49.426230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 527/1054] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:49 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:50.452411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:50.453023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:50.459430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:50.459919 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:50.460359 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:50.461052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:50.461505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:50.461927 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:50.589306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:50.597662 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:50.599189 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:50.600348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b88728e3-63fa-495d-91c9-fc6f87d09643 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.152162 Oct 06 04:41:50.600898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 528/1055] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:50 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:41:51.626075 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:51.626701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:51.633087 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:51.633566 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:51.634003 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:51.634689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:51.635165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:51.635586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:51.764608 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:51.772623 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:51.774042 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:51.775230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-44f6a128-b5fd-43cd-979e-6ba30f813b8e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.153152 Oct 06 04:41:51.775789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 528/1056] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:51 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:52.801347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:52.801962 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:52.808500 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:52.808999 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:52.809438 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:52.810136 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:52.810616 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:52.811076 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:52.939080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:52.947097 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:52.948570 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:52.949729 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3953db8a-6801-468e-913d-ab2727c4c78b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.152314 Oct 06 04:41:52.950288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 529/1057] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:52 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:53.974929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:53.975538 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:53.981915 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:53.983088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:53.983555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:53.984246 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:53.984701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:53.985125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:54.112794 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:54.121423 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:54.123599 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:54.124941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ecd96595-e8e9-4fd8-b00e-bdf8250b5e89 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.153887 Oct 06 04:41:54.125523 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 529/1058] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:53 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:55.150984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:55.151630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:55.158785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:55.159447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:55.159882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:55.160617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:55.161209 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:55.161707 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:55.308542 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:55.318267 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:55.319735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:55.320929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-37860d20-508e-40a1-9bfa-401b16e79cb2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.173991 Oct 06 04:41:55.321492 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 530/1059] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:55 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:56.347331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:56.347956 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:56.354316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:56.354791 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:56.355254 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:56.355937 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:56.356382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:56.356798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:56.484331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:56.492399 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:56.493827 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:56.495261 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-47646b19-4172-4c58-91cb-08d8acd871e1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.151778 Oct 06 04:41:56.495821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 530/1060] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:56 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:57.521007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:57.521610 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:57.527960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:57.528439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:57.528887 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:57.529584 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:57.530034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:57.530452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:57.533071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:57.658676 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:57.666835 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:57.668605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:57.670360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-31ac985d-13cf-4e14-b6b1-b25b5c3ffc24 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.152920 Oct 06 04:41:57.670929 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 531/1061] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:57 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:58.697778 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:58.698393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:58.700817 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:58.706142 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:58.706627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:58.707091 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:58.707787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:58.708245 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:58.708676 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:58.712071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:58.842107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:58.850046 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:58.851481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:41:58.852632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b2b5320a-e245-4d73-a4d0-c6ee9a55590a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.158876 Oct 06 04:41:58.853189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 531/1062] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:58 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:41:59.879314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:41:59.879949 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:41:59.882334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:41:59.887518 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:59.888000 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:59.888440 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:41:59.889131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:41:59.889584 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:41:59.890007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:00.018477 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:00.026373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:00.027827 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:00.029556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2c2e4543-c18f-4de4-97bd-bd918ab336cd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.153660 Oct 06 04:42:00.030111 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 532/1063] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:41:59 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:01.054826 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:01.055394 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:01.062103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:01.062574 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:01.063039 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:01.063726 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:01.064171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:01.064588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:01.190949 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:01.198949 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:01.200413 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:01.202171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e68d7a54-ea25-48ba-bb11-b604f0e7141e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1747 microversion: 2.20 time: 0.151310 Oct 06 04:42:01.202928 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 532/1064] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:01 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:02.228282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:02.228902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:02.235704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:02.236192 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:02.236624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:02.237318 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:02.237821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:02.238246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:02.380241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:02.388840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:02.390407 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:02.391587 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-11be3978-4441-4ad1-8e12-8356d7ca0382 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1747 microversion: 2.20 time: 0.167219 Oct 06 04:42:02.392153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 533/1065] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:02 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1747 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:03.417690 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:03.418299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:03.425302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:03.425785 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:03.426221 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:03.426911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:03.427391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:03.427814 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:03.553543 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:03.561880 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:03.563393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:03.564624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-14a10c4b-1e2f-4bc6-a0a5-32fa8d2a0e01 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1747 microversion: 2.20 time: 0.150860 Oct 06 04:42:03.565189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 533/1066] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:03 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:04.594284 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:04.594893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:04.601295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:04.601780 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:04.602216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:04.602915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:04.603402 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:04.603834 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:04.730297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:04.739234 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:04.740684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:04.741848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-538abf84-edaf-46ac-9337-e328b3942222 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1747 microversion: 2.20 time: 0.151466 Oct 06 04:42:04.742402 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 534/1067] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:04 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:05.768291 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:05.768900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:05.775355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:05.775838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:05.776267 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:05.776959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:05.777404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:05.777822 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:05.784994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-01635db5-5d3a-451c-831d-8d57506e5254 req-d8783262-9bfa-4680-9bb7-27707a6455c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40", "name": "network-vif-plugged", "status": "completed", "tag": "e7a92c66-1f21-4c39-8bbe-215d0840346a"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:42:05.796237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-01635db5-5d3a-451c-831d-8d57506e5254 req-d8783262-9bfa-4680-9bb7-27707a6455c0 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:05.796718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-01635db5-5d3a-451c-831d-8d57506e5254 req-d8783262-9bfa-4680-9bb7-27707a6455c0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:05.797157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-01635db5-5d3a-451c-831d-8d57506e5254 req-d8783262-9bfa-4680-9bb7-27707a6455c0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:05.808863 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-01635db5-5d3a-451c-831d-8d57506e5254 req-d8783262-9bfa-4680-9bb7-27707a6455c0 service nova] Creating event network-vif-plugged:e7a92c66-1f21-4c39-8bbe-215d0840346a for instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 on hv-cinder-86022 Oct 06 04:42:05.815110 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-01635db5-5d3a-451c-831d-8d57506e5254 req-d8783262-9bfa-4680-9bb7-27707a6455c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034114 Oct 06 04:42:05.815717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 535/1068] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:42:05.914997 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:05.923526 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:05.924992 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:05.926151 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-cec254ff-553c-414f-95c1-065c9ac53e0f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1747 microversion: 2.20 time: 0.162821 Oct 06 04:42:05.926708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 534/1069] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:05 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:06.954310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:06.956184 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:06.963154 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:06.964249 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:06.966413 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:06.967395 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:06.968053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:06.968673 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:07.131129 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:07.150661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:07.152206 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:07.153703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c95a6bc0-2c95-4940-b796-0002e5d340f2 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1742 microversion: 2.20 time: 0.205200 Oct 06 04:42:07.167326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 536/1070] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:06 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:08.180320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:08.180939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:08.188297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:08.189010 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:08.189689 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:08.190590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:08.191388 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:08.192279 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:08.358771 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:08.369550 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:08.371165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:08.372714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b44a921f-ac42-4672-8a9b-b843e8c0ad31 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1742 microversion: 2.20 time: 0.196955 Oct 06 04:42:08.373514 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 535/1071] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:08 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:09.402056 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:09.406021 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:09.413087 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:09.415657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:09.416424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:09.417144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:09.417767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:09.418191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:09.557199 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:09.566039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:09.568089 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:09.569383 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-75fa160c-f98a-4ba7-b978-757f01a5b5fd tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1742 microversion: 2.20 time: 0.171691 Oct 06 04:42:09.570013 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 537/1072] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:09 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:10.594710 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:10.595356 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:10.601976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:10.602469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:10.602906 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:10.603636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:10.604084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:10.604675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:10.952706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:10.961478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:10.963513 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:10.964428 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2d2579cb-b1d1-4ad5-9ce1-7efea4e9d508 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1742 microversion: 2.20 time: 0.373792 Oct 06 04:42:10.965298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 536/1073] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:10 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1742 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:11.990003 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:11.991328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:11.998998 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:11.999599 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:12.000036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:12.000740 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:12.001210 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:12.001630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:12.233906 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:12.242524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:12.244489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:12.245866 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-18dd0ccf-9aa2-48b0-a1eb-81286b608d39 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1742 microversion: 2.20 time: 0.259956 Oct 06 04:42:12.246524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 538/1074] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:11 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1742 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:13.272431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:13.273159 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:13.283742 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:13.284242 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:13.284684 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:13.285404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:13.285865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:13.286300 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:13.428357 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:13.437790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:13.439259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:13.440773 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a70f7267-6aeb-4157-915a-c8568a50a55a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1742 microversion: 2.20 time: 0.171986 Oct 06 04:42:13.441641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 537/1075] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:13 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:14.468056 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:14.468639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:14.475460 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:14.476015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:14.476448 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:14.477207 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:14.477657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:14.478097 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:14.624645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:14.633776 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:14.635247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:14.636452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cb1233d8-4f87-4627-878b-d41ba0da9189 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1742 microversion: 2.20 time: 0.173204 Oct 06 04:42:14.637008 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 539/1076] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:14 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:15.667114 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:15.667839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:15.677313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:15.677866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:15.678302 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:15.679026 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:15.679477 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:15.679909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:15.819339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:15.827938 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:15.829432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:15.830624 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-85a63614-7855-431b-8680-db77c6c612f6 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1742 microversion: 2.20 time: 0.167566 Oct 06 04:42:15.831241 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 538/1077] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:15 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:16.857105 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:16.857718 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:16.864343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:16.864831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:16.865269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:16.865974 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:16.866438 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:16.866865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:16.999377 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:17.007477 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:17.009334 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:17.010893 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-efb40ced-b164-47de-8d62-cb7a4c404915 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1724 microversion: 2.20 time: 0.157580 Oct 06 04:42:17.011752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 540/1078] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:16 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:18.036427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:18.037059 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:18.043578 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:18.044187 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:18.044633 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:18.045327 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:18.045780 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:18.046214 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:18.176209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:18.184188 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:18.186491 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:18.187685 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f7fbff82-7e6a-49dc-806d-7084b46e642b tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1724 microversion: 2.20 time: 0.155209 Oct 06 04:42:18.188247 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 539/1079] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:18 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:19.217099 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:19.217099 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:19.224608 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:19.225102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:19.225538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:19.226255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:19.226710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:19.227259 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:19.362083 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:19.370477 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:19.372040 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:19.373188 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-89f56af3-c9a7-48f0-925c-f469d8d9eef0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1727 microversion: 2.20 time: 0.163070 Oct 06 04:42:19.373945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 541/1080] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:19 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:19.398109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dac34099-d262-4af0-b0cd-6cdd8aa1e2c5"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:42:19.400590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:19.407601 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:19.408086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:19.408522 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:19.409218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:19.409672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:19.410091 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:19.678497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2c092f27-d20f-4a8f-bfdf-cb959a352fbb tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284353 Oct 06 04:42:19.679114 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 540/1081] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Oct 6 04:42:19 2022] POST /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 04:42:19.802445 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:19.802933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:19.808735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:19.809209 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:19.809684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:19.810366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:19.810815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:19.811257 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:20.051391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b2667661-5844-4e30-a970-01362d24c98a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/os-volume_attachments/dac34099-d262-4af0-b0cd-6cdd8aa1e2c5" status: 202 len: 0 microversion: 2.20 time: 0.252713 Oct 06 04:42:20.051983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 542/1082] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Oct 6 04:42:19 2022] DELETE /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/os-volume_attachments/dac34099-d262-4af0-b0cd-6cdd8aa1e2c5 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:42:20.111418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:42:20.112000 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:20.117843 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:20.118323 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:20.118758 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:20.119725 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:20.120172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:20.120588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:20.162407 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127098) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 04:42:20.229166 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7acc1782-f8ce-4efc-ba64-b3b294be1af4 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "POST /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/action" status: 202 len: 0 microversion: 2.20 time: 0.120716 Oct 06 04:42:20.229428 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 541/1083] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Oct 6 04:42:20 2022] POST /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:42:20.238112 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:20.238728 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:20.246140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:20.246633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:20.247904 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:20.248621 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:20.249082 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:20.249510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:20.410932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:20.420170 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:20.421647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:20.422824 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-52707fd7-b213-40d2-b699-e53bf4374b9a tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1675 microversion: 2.20 time: 0.188655 Oct 06 04:42:20.423524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 543/1084] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:20 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:21.449888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:21.450786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:21.457528 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:21.458024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:21.458459 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:21.459195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:21.459646 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:21.460069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:21.665405 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:21.674539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:21.676001 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:21.677168 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4753f58b-47d5-43ee-9d63-beca5f8997d3 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.231825 Oct 06 04:42:21.677724 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 542/1085] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:21 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:21.901213 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-b16d2db1-28f6-4bd1-bab6-03c3da65ef69 req-bec8ce55-f817-4306-a3a8-3275815ed8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40", "name": "network-vif-unplugged", "status": "completed", "tag": "e7a92c66-1f21-4c39-8bbe-215d0840346a"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:42:21.915265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b16d2db1-28f6-4bd1-bab6-03c3da65ef69 req-bec8ce55-f817-4306-a3a8-3275815ed8ea service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:21.915760 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b16d2db1-28f6-4bd1-bab6-03c3da65ef69 req-bec8ce55-f817-4306-a3a8-3275815ed8ea service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:21.916216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b16d2db1-28f6-4bd1-bab6-03c3da65ef69 req-bec8ce55-f817-4306-a3a8-3275815ed8ea service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:21.929036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-b16d2db1-28f6-4bd1-bab6-03c3da65ef69 req-bec8ce55-f817-4306-a3a8-3275815ed8ea service nova] Creating event network-vif-unplugged:e7a92c66-1f21-4c39-8bbe-215d0840346a for instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 on hv-cinder-86022 Oct 06 04:42:21.934361 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-b16d2db1-28f6-4bd1-bab6-03c3da65ef69 req-bec8ce55-f817-4306-a3a8-3275815ed8ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037007 Oct 06 04:42:21.934989 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 544/1086] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:42:22.704006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:22.704613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:22.711405 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:22.711890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:22.712324 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:22.713029 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:22.713476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:22.714089 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:22.854822 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:22.863593 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:22.865048 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:22.866215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-cdeb092b-11b3-4c93-805d-157bd965847c tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.166434 Oct 06 04:42:22.866777 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 543/1087] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:22 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:23.749357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:23.750093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:23.767151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:23.767811 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:23.768348 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:23.769150 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:23.769701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:23.770221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:23.794379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b2b30701-42bd-4ca7-9a8c-c044a53bb4ea tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/ips" status: 200 len: 144 microversion: 2.1 time: 0.050337 Oct 06 04:42:23.795619 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 545/1088] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:42:23 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/ips => generated 144 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:23.893345 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:23.893955 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:23.901322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:23.901807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:23.902708 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:23.903786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:23.905007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:23.905975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:23.924756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:24.118807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:24.137024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:24.139043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:24.140580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ccf48132-bd27-4e20-b47c-50383eebd14f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.251077 Oct 06 04:42:24.141774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 544/1089] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:23 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:25.165798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feb0941e-e8fb-4ccc-850e-b680faa8c499"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:42:25.168693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:25.174260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:25.174874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:25.176591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:25.177101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:25.177550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:25.178271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:25.178734 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:25.179242 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:25.182259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:25.182751 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:25.183220 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:25.184534 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:25.185035 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:25.185551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:25.269174 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:25.347439 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:25.357651 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:25.359306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:25.360489 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ab6f2657-7d22-40c0-975b-1d7743f10396 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.190030 Oct 06 04:42:25.361260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 545/1090] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:25 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:26.386584 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:26.387363 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:26.395143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:26.395632 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:26.396070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:26.396771 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:26.397228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:26.397656 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:26.537103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:26.546013 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:26.547498 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:26.548674 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f9119f06-7dc3-428b-a11c-1336ca4a0741 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.166054 Oct 06 04:42:26.549443 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 546/1091] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:26 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:27.722192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:27.722835 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:27.728935 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:27.729415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:27.730108 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:27.731053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:27.731838 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:27.732591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:27.874062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:27.882478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:27.883961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:27.885145 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-910b2d6e-bb8b-472f-9bef-3c3fb93b7cff tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.314584 Oct 06 04:42:27.885919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 547/1092] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:27 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:28.910359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:28.911183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:28.913171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:28.919476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:28.920055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:28.920475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:28.921193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:28.921652 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:28.922085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:29.084619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:29.093995 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:29.095552 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:29.096987 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d1c3189c-6023-4e78-bb81-d06cf6a432ab tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.190632 Oct 06 04:42:29.100630 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 548/1093] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:28 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:30.126178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:30.126986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:30.133781 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:30.134359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:30.135052 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:30.138839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:30.138839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:30.138839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:30.308680 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:30.317864 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:30.319371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:30.320533 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c48e87c3-74cd-4069-a389-ad1ef3da42d5 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.198496 Oct 06 04:42:30.321415 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 549/1094] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:30 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:31.346234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:31.346929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:31.353126 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:31.353607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:31.354038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:31.354723 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:31.355208 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:31.355627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:31.482605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:31.491137 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:31.492571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:31.493716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d47ade02-1cf2-4557-9ccd-4b652c757cdc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.151915 Oct 06 04:42:31.494535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 550/1095] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:31 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:32.519873 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:32.520518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:32.526811 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:32.527334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:32.527774 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:32.528455 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:32.528901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:32.529320 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:32.657673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:32.665679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:32.667129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:32.668278 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9e76da1a-fcda-4eb2-a2f6-fbea229f526f tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.152362 Oct 06 04:42:32.668837 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 551/1096] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:32 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:33.694119 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:33.694787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:33.701139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:33.701623 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:33.702069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:33.703283 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:33.703747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:33.704173 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:33.839779 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:33.847876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:33.849298 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:33.850466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9e434ded-45cd-4044-b258-43fee3d2127e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.160260 Oct 06 04:42:33.851014 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 552/1097] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:33 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:34.876605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:34.877259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:34.883727 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:34.884146 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:34.884572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:34.885256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:34.885701 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:34.886118 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:35.017243 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:35.025306 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:35.026745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:35.027922 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5811ce85-f244-4e35-b237-7c4fe406f47d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.155743 Oct 06 04:42:35.028483 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 553/1098] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:34 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:35.174441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=29 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:36.052992 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:36.053582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:36.060031 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:36.060509 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:36.060943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:36.061892 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:36.062334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:36.062755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:36.193219 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:36.201191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:36.203315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:36.204478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e89e987c-9efd-476a-90f4-a6d60d895a41 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.155408 Oct 06 04:42:36.205033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 554/1099] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:36 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 04:42:36.634622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2c4d10ae-50ea-434e-b0cb-b1f90e207b3c tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.472756 Oct 06 04:42:36.635367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 546/1100] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:42:25 2022] POST /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments => generated 194 bytes in 11474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:42:37.229386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:37.230561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:37.238460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:37.238939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:37.239444 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:37.240143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:37.240591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:37.241010 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:37.377502 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:37.385473 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:37.386892 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:37.388068 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2d0d9012-e8a0-4c80-b706-176c60f1496e tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.162659 Oct 06 04:42:37.388628 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 555/1101] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:37 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:38.415821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:38.416710 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:38.423672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:38.424066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:38.424505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:38.425303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:38.425766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:38.426197 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:38.579961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:38.590838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:38.593659 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:38.595057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b8bb778d-e8e7-42d7-b66b-ddcccbd0280d tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1733 microversion: 2.20 time: 0.185059 Oct 06 04:42:38.596556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 547/1102] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:38 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:39.415417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:39.415990 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:39.422870 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:39.423382 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:39.423819 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:39.424503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:39.424949 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:39.425367 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:39.449165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1326b15e-d745-4e11-b200-66bd576b72c5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/ips" status: 200 len: 148 microversion: 2.1 time: 0.037504 Oct 06 04:42:39.449803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 556/1103] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Oct 6 04:42:39 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:39.620464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:39.621081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:39.629967 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:39.630565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:39.631036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:39.631934 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:39.632554 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:39.633008 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:39.771311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:39.781204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:39.782172 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:39.783432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c1e4ecdb-94bc-4706-94d0-dc5907103172 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1720 microversion: 2.20 time: 0.167068 Oct 06 04:42:39.783993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 548/1104] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:42:39 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:42:39.968480 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-2606f340-547f-4f7e-ac53-854ca0a3a5bb req-ae6d8a8d-e64d-4008-81cc-30af7a5fa4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40", "name": "network-vif-plugged", "status": "completed", "tag": "e7a92c66-1f21-4c39-8bbe-215d0840346a"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:42:39.978346 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2606f340-547f-4f7e-ac53-854ca0a3a5bb req-ae6d8a8d-e64d-4008-81cc-30af7a5fa4c4 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:39.978856 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2606f340-547f-4f7e-ac53-854ca0a3a5bb req-ae6d8a8d-e64d-4008-81cc-30af7a5fa4c4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:39.979334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2606f340-547f-4f7e-ac53-854ca0a3a5bb req-ae6d8a8d-e64d-4008-81cc-30af7a5fa4c4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:39.991730 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-2606f340-547f-4f7e-ac53-854ca0a3a5bb req-ae6d8a8d-e64d-4008-81cc-30af7a5fa4c4 service nova] Creating event network-vif-plugged:e7a92c66-1f21-4c39-8bbe-215d0840346a for instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 on hv-cinder-86022 Oct 06 04:42:39.997227 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-2606f340-547f-4f7e-ac53-854ca0a3a5bb req-ae6d8a8d-e64d-4008-81cc-30af7a5fa4c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 Oct 06 04:42:39.997817 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 557/1105] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:40.792903 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "025d2a5a-bff1-4be7-8b19-31f71d5f9402"}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:42:40.795406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:40.803155 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:40.803642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:40.804077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:40.804768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:40.805217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:40.805639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:41.069876 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-08af848b-145e-4be6-b21a-05a67a9ed522 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "POST /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280736 Oct 06 04:42:41.073071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 549/1106] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:42:40 2022] POST /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:44.176875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:44.179232 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:44.185330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:44.185812 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:44.187022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:44.187720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:44.188177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:44.188598 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:44.218042 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0bd76678-3bfd-4271-869f-bc2ecf873039 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Oct 06 04:42:44.218606 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 558/1107] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:44 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:44.230248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:44.231161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:44.239379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:44.239868 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:44.240306 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:44.241000 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:44.241453 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:44.241882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:44.271815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1ad38d5a-1ce1-40e6-a905-fe8e84eee857 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/feb0941e-e8fb-4ccc-850e-b680faa8c499" status: 200 len: 194 microversion: 2.1 time: 0.046350 Oct 06 04:42:44.272400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 550/1108] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Oct 6 04:42:44 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/feb0941e-e8fb-4ccc-850e-b680faa8c499 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:42:45.629924 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24e37776-4685-44d9-8bde-c79a6f012e0b"}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:42:45.632321 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:45.639044 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:45.639540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:45.640208 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:45.641063 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:45.641518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:45.641939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:45.911232 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-95d1a58c-f826-4640-b151-6375d299c93d tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "POST /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287911 Oct 06 04:42:45.911832 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 559/1109] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Oct 6 04:42:45 2022] POST /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:50.821618 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:50.822096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:50.828632 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:50.829117 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:50.829584 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:50.830248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:50.830703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:50.831158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:50.911301 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'services' on Instance uuid c1058bc0-f3b2-48bf-b41e-004403add62f {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:42:50.993058 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-22b3d38d-d2e3-4c61-a58e-04f1c58287b1 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments/025d2a5a-bff1-4be7-8b19-31f71d5f9402" status: 202 len: 0 microversion: 2.1 time: 0.175033 Oct 06 04:42:50.993603 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 551/1110] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:42:50 2022] DELETE /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments/025d2a5a-bff1-4be7-8b19-31f71d5f9402 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:42:51.004518 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:51.006865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:51.015844 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:51.016506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:51.016976 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:51.017682 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:51.018131 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:51.018554 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:51.034219 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:51.054909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-73f707d0-e259-4118-b5d8-3eddb8d22ef7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055945 Oct 06 04:42:51.055500 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 560/1111] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:50 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:52.069492 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:52.071831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:52.078560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:52.079071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:52.079506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:52.080199 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:52.080645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:52.081064 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:52.109125 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e8a8816d-77d7-405b-be83-058b98a0e39d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Oct 06 04:42:52.109664 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 552/1112] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:52 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:53.121442 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:53.124272 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:53.130596 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:53.131114 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:53.131549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:53.132234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:53.132682 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:53.133103 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:53.162164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d3753366-627d-4165-94cf-34884f799331 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045219 Oct 06 04:42:53.162714 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 561/1113] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:53 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:54.175658 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:54.177789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:54.184144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:54.184625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:54.185056 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:54.185747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:54.186197 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:54.186617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:54.215805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3c6f7547-4db7-4688-a0e1-5d5cdfda65c2 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Oct 06 04:42:54.215976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 553/1114] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:54 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:55.228511 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:55.230664 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:55.237116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:55.237590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:55.238013 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:55.238693 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:55.239166 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:55.239585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:55.268719 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-06690b00-91cc-41ec-b135-62a51b500eed tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Oct 06 04:42:55.269263 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 562/1115] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:55 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:56.281130 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:56.283404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:56.289898 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:56.290375 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:56.290807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:56.291533 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:56.291985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:56.292404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:56.322044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a559a1f9-caa2-4285-a647-241537b644d6 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Oct 06 04:42:56.322587 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 554/1116] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:56 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:57.333940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:57.336121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:57.342517 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:57.343530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:57.343966 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:57.344647 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:57.345093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:57.345516 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:57.376195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-49eb01fb-41fa-4fc5-a0bc-5c5433ac82c9 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046318 Oct 06 04:42:57.376734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 563/1117] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:57 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:57.676038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:57.678232 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:57.684604 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:57.685093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:57.685538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:57.686240 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:57.686755 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:57.687425 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:57.717256 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-28ecd85a-0f1d-4f12-9ba9-ff4eb45244dd tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045130 Oct 06 04:42:57.717807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 555/1118] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:57 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:57.865049 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:57.865718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:57.873113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:57.873594 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:57.874024 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:57.875294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:57.875920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:57.876342 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:57.906941 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-acdbfd3c-3a75-4f25-83f9-0eba71c18770 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/feb0941e-e8fb-4ccc-850e-b680faa8c499" status: 200 len: 194 microversion: 2.1 time: 0.046885 Oct 06 04:42:57.907558 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 564/1119] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Oct 6 04:42:57 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/feb0941e-e8fb-4ccc-850e-b680faa8c499 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:57.917635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:57.918161 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:57.924316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:57.924802 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:57.925239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:57.925930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:57.926383 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:57.926809 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:58.010581 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lazy-loading 'services' on Instance uuid 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:42:58.082983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ab33a719-2b07-4266-8e87-d5faae33c8e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/feb0941e-e8fb-4ccc-850e-b680faa8c499" status: 202 len: 0 microversion: 2.1 time: 0.169016 Oct 06 04:42:58.083626 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 556/1120] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:42:57 2022] DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/feb0941e-e8fb-4ccc-850e-b680faa8c499 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:42:58.388776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:58.390926 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:58.397249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:58.397729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:58.398165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:58.398854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:58.399331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:58.399761 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:58.428869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0223d3f7-58d3-43c8-a582-fe1efb020cbe tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Oct 06 04:42:58.429416 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 565/1121] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:58 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:42:59.442237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:59.444595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:59.450641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:59.451166 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:59.451601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:59.452308 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:59.452759 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:59.453180 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:59.481848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-67fe6688-c448-4a82-b790-249b106221cb tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044352 Oct 06 04:42:59.482386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 557/1122] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:42:59 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:42:59.546911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:59.547451 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:59.549721 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=36 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:42:59.554919 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:59.555439 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:59.555899 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:59.556586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:59.557063 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:59.557485 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:59.583269 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:42:59.661495 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b8f749dd-35e7-4732-a050-3662c5e2e860 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 204 len: 0 microversion: 2.1 time: 0.118617 Oct 06 04:42:59.662178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 566/1123] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:42:59 2022] DELETE /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:42:59.670598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:42:59.671942 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:42:59.677827 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:59.678307 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:59.678737 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:59.679452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:42:59.679902 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:42:59.680326 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:42:59.810800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:42:59.818530 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-091778b1-cc9f-416c-ba7a-2c63c57edfd7 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1680 microversion: 2.1 time: 0.151988 Oct 06 04:42:59.819107 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 558/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:42:59 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:00.262191 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:00.262766 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:00.269324 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:00.269801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:00.270236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:00.270918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:00.271392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:00.271810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:00.299672 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a1fb25dd-6b9a-486e-988c-5d915b574c93 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/24e37776-4685-44d9-8bde-c79a6f012e0b" status: 200 len: 194 microversion: 2.1 time: 0.041861 Oct 06 04:43:00.300232 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 567/1125] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Oct 6 04:43:00 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/24e37776-4685-44d9-8bde-c79a6f012e0b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:00.310555 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:00.311079 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:00.317481 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:00.317966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:00.318403 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:00.319137 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:00.319595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:00.320021 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:00.338025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:00.402562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lazy-loading 'services' on Instance uuid 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:43:00.475761 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fff544f4-ae58-4147-868c-48f30071819e tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/24e37776-4685-44d9-8bde-c79a6f012e0b" status: 202 len: 0 microversion: 2.1 time: 0.168946 Oct 06 04:43:00.476384 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 559/1126] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Oct 6 04:43:00 2022] DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments/24e37776-4685-44d9-8bde-c79a6f012e0b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:43:00.842253 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:00.843462 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:00.850089 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:00.850577 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:00.851050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:00.851754 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:00.852244 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:00.852686 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:00.979614 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:00.987736 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-01fbf01d-59a7-42f7-a5a0-5fc23562aaab tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1680 microversion: 2.1 time: 0.149349 Oct 06 04:43:00.988334 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 568/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:00 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:02.014329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:02.015679 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:02.022071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:02.022564 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:02.023028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:02.023769 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:02.024225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:02.024649 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:02.159728 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:02.168432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f745657e-a632-4615-b8ba-2e3e3f317f36 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1680 microversion: 2.1 time: 0.159640 Oct 06 04:43:02.169251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 560/1128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:02 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:02.714717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:02.716977 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:02.723950 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:02.724657 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:02.725107 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:02.725766 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:02.726205 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:02.726626 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:02.758729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d0b881f1-3301-4c35-ad16-488e63c2ff64 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047874 Oct 06 04:43:02.760533 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 569/1129] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:43:02 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:43:02.883325 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:02.886796 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:02.897198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:02.897693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:02.898129 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:02.898832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:02.899313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:02.899739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:02.933822 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a19fab55-786b-41d5-807c-f84f549a3582 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053931 Oct 06 04:43:02.935085 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 561/1130] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Oct 6 04:43:02 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 04:43:02.949079 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-5fa1229f-36ed-4a40-aba5-a307d3350de8 req-329266aa-8e6a-4ee6-a163-178b55ea7a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1058bc0-f3b2-48bf-b41e-004403add62f", "name": "network-vif-deleted", "tag": "439785b6-0b32-4a32-8348-4a5f35fd1657"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:43:02.962648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5fa1229f-36ed-4a40-aba5-a307d3350de8 req-329266aa-8e6a-4ee6-a163-178b55ea7a77 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:02.963287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5fa1229f-36ed-4a40-aba5-a307d3350de8 req-329266aa-8e6a-4ee6-a163-178b55ea7a77 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:02.963849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5fa1229f-36ed-4a40-aba5-a307d3350de8 req-329266aa-8e6a-4ee6-a163-178b55ea7a77 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:03.000966 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-5fa1229f-36ed-4a40-aba5-a307d3350de8 req-329266aa-8e6a-4ee6-a163-178b55ea7a77 service nova] Creating event network-vif-deleted:439785b6-0b32-4a32-8348-4a5f35fd1657 for instance c1058bc0-f3b2-48bf-b41e-004403add62f on hv-cinder-86022 Oct 06 04:43:03.006806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-5fa1229f-36ed-4a40-aba5-a307d3350de8 req-329266aa-8e6a-4ee6-a163-178b55ea7a77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062651 Oct 06 04:43:03.011460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 570/1131] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:03.015855 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:03.016623 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:03.024471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:03.024993 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:03.025409 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:03.026117 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:03.026575 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:03.027019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:03.057937 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:43:03.139784 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cbc14386-df48-40a3-901d-d852953177a6 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 204 len: 0 microversion: 2.1 time: 0.130298 Oct 06 04:43:03.140253 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 562/1132] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:43:03 2022] DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 04:43:03.149627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:03.150697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:03.157975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:03.158466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:03.158903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:03.159662 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:03.160127 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:03.160554 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:03.192961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:03.193972 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:03.200010 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:03.200499 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:03.200925 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:03.201799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:03.202502 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:03.202882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:03.238284 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:03.238767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:03.239233 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:03.239677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'fault' on Instance uuid c1058bc0-f3b2-48bf-b41e-004403add62f {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:43:03.283215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:03.292317 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2033be80-de4d-4602-bf39-8116752f5c27 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1331 microversion: 2.1 time: 0.103659 Oct 06 04:43:03.292912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 563/1133] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:03 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:43:03.308744 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:03.316943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-dab65647-fc8a-4dd5-9826-fb8c872f3cca tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1670 microversion: 2.1 time: 0.172311 Oct 06 04:43:03.317520 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 571/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:03 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:04.320339 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:04.320960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:04.327359 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:04.328003 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:04.328445 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:04.329147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:04.329605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:04.330037 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:04.340050 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:04.340666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:04.347216 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:04.347703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:04.348137 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:04.348831 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:04.349284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:04.349707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:04.361617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:04.362100 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:04.362537 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:04.363005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lazy-loading 'fault' on Instance uuid c1058bc0-f3b2-48bf-b41e-004403add62f {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:43:04.403476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68d73b5efc74b3380429cf72e506905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653e21693b6f4a3ca8b739f1290df3aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:04.411333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4d3ac4e0-674f-4fd8-9c56-bf1dbbcb550f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 200 len: 1331 microversion: 2.1 time: 0.094826 Oct 06 04:43:04.411900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 564/1135] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:04 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:04.481614 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:04.489540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0adcd627-0154-4ed3-81dc-b5550ddf7f70 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1670 microversion: 2.1 time: 0.153263 Oct 06 04:43:04.490098 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 572/1136] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:04 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:43:05.434320 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:05.435035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:05.437595 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:05.444001 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:05.444528 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:05.444975 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:05.445932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:05.446430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:05.446860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:05.461159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f HTTP/1.1 Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:05.463050 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:05.464781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'c1058bc0-f3b2-48bf-b41e-004403add62f'} Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:05.466077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:05.468386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:05.469977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:05.469977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9bd6701c-b651-486e-b57e-0453093fe78d tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 404 len: 111 microversion: 2.1 time: 0.034082 Oct 06 04:43:05.469977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 565/1137] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:05 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:05.474353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-917f1178-c855-4834-af41-bd1679f4932a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '.version_select at 0x7f0c42cf7a60>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:05.494704 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-917f1178-c855-4834-af41-bd1679f4932a tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486238852" status: 202 len: 0 microversion: 2.1 time: 0.023927 Oct 06 04:43:05.495328 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 573/1138] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Oct 6 04:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486238852 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:43:05.512204 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:05.512815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:05.518671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:05.519190 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:05.519630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:05.520327 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:05.520785 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:05.521198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:05.673638 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:05.681476 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3c19d549-20ea-485a-8e71-a2189cf58e3f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1670 microversion: 2.1 time: 0.173192 Oct 06 04:43:05.682115 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 566/1139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:05 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:06.219618 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-4a086ab6-72c6-4549-9c35-326ecefd5510 req-7c551838-f7f3-48f7-a2c4-8e1b11c631fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e74e585-b622-4beb-bc2c-f71b2be5e2f7", "name": "network-vif-deleted", "tag": "f7c2a9af-8931-4eb7-ae06-a2e1d0566270"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:43:06.230031 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-4a086ab6-72c6-4549-9c35-326ecefd5510 req-7c551838-f7f3-48f7-a2c4-8e1b11c631fa service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:06.230516 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-4a086ab6-72c6-4549-9c35-326ecefd5510 req-7c551838-f7f3-48f7-a2c4-8e1b11c631fa service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:06.231006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-4a086ab6-72c6-4549-9c35-326ecefd5510 req-7c551838-f7f3-48f7-a2c4-8e1b11c631fa service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:06.244808 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-4a086ab6-72c6-4549-9c35-326ecefd5510 req-7c551838-f7f3-48f7-a2c4-8e1b11c631fa service nova] Creating event network-vif-deleted:f7c2a9af-8931-4eb7-ae06-a2e1d0566270 for instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 on hv-cinder-86022 Oct 06 04:43:06.254228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-4a086ab6-72c6-4549-9c35-326ecefd5510 req-7c551838-f7f3-48f7-a2c4-8e1b11c631fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039938 Oct 06 04:43:06.258545 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 574/1140] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:06.705217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:06.705912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:06.712998 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:06.713484 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:06.713916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:06.714617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:06.715110 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:06.715532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:06.747318 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:06.747738 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:06.748166 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:06.748614 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.objects.instance [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lazy-loading 'fault' on Instance uuid 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 {{(pid=127097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:43:06.795007 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c86f73f98a4fb2af787534fd47e2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53abe2cc7a94ddaadb68b26b57faf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:06.804349 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5ff2c4ea-bb1e-494c-8a0b-d4f4976920a5 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 200 len: 1326 microversion: 2.1 time: 0.103208 Oct 06 04:43:06.805020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 567/1141] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:06 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:07.516283 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:07.516789 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:07.522824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:07.523333 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:07.523762 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:07.524445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:07.524893 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:07.525313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:07.538418 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: DELETE /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f HTTP/1.1 Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:07.540043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.541640 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': 'c1058bc0-f3b2-48bf-b41e-004403add62f'} Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:07.542619 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.544183 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.546551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:07.546551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c58feb3e-089d-4c24-84a3-a3dd5766b155 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 404 len: 111 microversion: 2.1 time: 0.030214 Oct 06 04:43:07.546551 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 575/1142] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:43:07 2022] DELETE /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:07.550140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:07.550778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: c1058bc0-f3b2-48bf-b41e-004403add62f] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:07.556625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:07.557105 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:07.557538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:07.558224 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:07.558674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:07.559202 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:07.572544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f HTTP/1.1 Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:07.574028 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.575752 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'c1058bc0-f3b2-48bf-b41e-004403add62f'} Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:07.576712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. Oct 06 04:43:07.578245 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.579865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance c1058bc0-f3b2-48bf-b41e-004403add62f could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:07.579865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-bc5ad40a-a16a-4e60-8893-95c4ba1b0365 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f" status: 404 len: 111 microversion: 2.1 time: 0.029606 Oct 06 04:43:07.579865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 568/1143] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:07 2022] GET /compute/v2.1/servers/c1058bc0-f3b2-48bf-b41e-004403add62f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:07.828722 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:07.829359 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:07.835243 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:07.835731 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:07.836169 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:07.836891 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:07.837343 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:07.837787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:07.851900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] HTTP exception thrown: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Request method failure captured: Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 HTTP/1.1 Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpYC2BUnG4ObdHzyWGzWkBLMhja9vEdOfbzpI18tEBYbvfYTNyb-DEZYbnieVgFuBNRIHKd1ctD20-7k278JLkDda5yjGCYJwdWjOeCHEsDnrRmlmpFmlEyYUxk8JWq2uDT7eOjTxFnG9dPc9dPHz_S0FyoBN96cTJr9P49Ldfp3GM Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:07.853402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: 56c86f73f98a4fb2af787534fd47e2ed Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:07.855020 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '1e74e585-b622-4beb-bc2c-f71b2be5e2f7'} Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:07.855959 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:07.857490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:07.859739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Returning 404 to user: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:07.859739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4d872ae6-7384-4afb-b88c-170a79e6f431 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 404 len: 111 microversion: 2.1 time: 0.030085 Oct 06 04:43:07.859739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 576/1144] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:07 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:07.864196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0804d89e-f6be-434d-a1bf-4e90fb48206f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '.version_select at 0x7f0c42c221f0>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:07.882945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0804d89e-f6be-434d-a1bf-4e90fb48206f tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538593011" status: 202 len: 0 microversion: 2.1 time: 0.022465 Oct 06 04:43:07.883524 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 569/1145] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Oct 6 04:43:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538593011 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:43:08.712753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:08.713234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:08.720882 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:08.721366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:08.721804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:08.722498 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:08.722951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:08.723398 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:08.736989 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: DELETE /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da HTTP/1.1 Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:08.738553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.740172 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': 'fa90860d-54c2-4079-9291-a9bd449aa9da'} Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:08.741032 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.742458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.743929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:08.743929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-261ce44f-a485-4e3c-83f9-976b40ba7397 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 404 len: 111 microversion: 2.1 time: 0.031003 Oct 06 04:43:08.743929 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 577/1146] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:43:08 2022] DELETE /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:08.748733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:08.749399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: fa90860d-54c2-4079-9291-a9bd449aa9da] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:08.758247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:08.758740 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:08.759216 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:08.759923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:08.760381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:08.760813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:08.774147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da HTTP/1.1 Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:08.775806 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.777410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'fa90860d-54c2-4079-9291-a9bd449aa9da'} Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:08.778221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. Oct 06 04:43:08.779647 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.781381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance fa90860d-54c2-4079-9291-a9bd449aa9da could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:08.781381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-71173562-cddb-479d-aaab-357548c9f88f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da" status: 404 len: 111 microversion: 2.1 time: 0.032646 Oct 06 04:43:08.781381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 570/1147] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:08 2022] GET /compute/v2.1/servers/fa90860d-54c2-4079-9291-a9bd449aa9da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:08.787177 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:08.787683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:08.793576 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:08.794066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:08.794508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:08.795240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:08.795696 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:08.796161 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:08.810796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: DELETE /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 HTTP/1.1 Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:08.812510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.814234 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': 'b0802344-0cf0-48a1-b4cc-b2495c860ac2'} Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:08.815088 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.816426 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.817641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:08.817641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-76a92cb1-fa6c-455d-982c-83f2524e3e9f tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 404 len: 111 microversion: 2.1 time: 0.030851 Oct 06 04:43:08.817641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 578/1148] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:43:08 2022] DELETE /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:08.822607 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:08.823244 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: b0802344-0cf0-48a1-b4cc-b2495c860ac2] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:08.829854 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:08.830351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:08.830790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:08.831521 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:08.831981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:08.832409 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:08.846846 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 HTTP/1.1 Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:08.848379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.849914 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'b0802344-0cf0-48a1-b4cc-b2495c860ac2'} Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:08.850758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. Oct 06 04:43:08.852030 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:08.853510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance b0802344-0cf0-48a1-b4cc-b2495c860ac2 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:08.853510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-112ce338-09d7-40b1-90c5-19be52774f14 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2" status: 404 len: 111 microversion: 2.1 time: 0.031014 Oct 06 04:43:08.853510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 571/1149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:08 2022] GET /compute/v2.1/servers/b0802344-0cf0-48a1-b4cc-b2495c860ac2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:43:09.991383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:09.991886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:10.000171 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:10.000666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:10.001215 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:10.001984 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:10.002434 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:10.002865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:10.017602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: DELETE /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c HTTP/1.1 Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:10.019287 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.020971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': 'ba369ba5-73dc-42d2-a375-b15b0e42188c'} Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:10.021953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.023635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.025419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:10.025419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f84d18ae-094d-4ced-ae28-c6682c808091 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 404 len: 111 microversion: 2.1 time: 0.033427 Oct 06 04:43:10.025419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 579/1150] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:43:09 2022] DELETE /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:10.029672 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:10.030437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] [instance: ba369ba5-73dc-42d2-a375-b15b0e42188c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:10.037473 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:10.037960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:10.038437 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:10.039178 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:10.039639 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:10.040101 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:10.053821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] HTTP exception thrown: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Request method failure captured: Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c HTTP/1.1 Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpat75fJi6NTJ5RoPe8t4tNCdOs-xE4E7y7t08xIVyQjOirSlrPqhF1FVS7uN25dkdnkkJNewBg6TrFRyLhs7nH5aF5tdOnYz830-WxQjLaUgfb3VwllbPCA2y6HKcUQl2GrZiuxrdgMSVSjuegXNFeiW3oBI6P0iz4D3lk1n5yaug Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:10.055367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/653e21693b6f4a3ca8b739f1290df3aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 653e21693b6f4a3ca8b739f1290df3aa Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-963820692 Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: f68d73b5efc74b3380429cf72e506905 Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeNegativeTest-963820692-project Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.056987 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'ba369ba5-73dc-42d2-a375-b15b0e42188c'} Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:10.057781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. Oct 06 04:43:10.059070 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.060202 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] Returning 404 to user: Instance ba369ba5-73dc-42d2-a375-b15b0e42188c could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:10.060202 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4c9d3e9a-5dcd-4dae-a494-d67e65e7ebd5 tempest-AttachVolumeNegativeTest-963820692 tempest-AttachVolumeNegativeTest-963820692-project] 10.222.0.33 "GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c" status: 404 len: 111 microversion: 2.1 time: 0.031326 Oct 06 04:43:10.060202 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 572/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:10 2022] GET /compute/v2.1/servers/ba369ba5-73dc-42d2-a375-b15b0e42188c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:43:10.757968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:10.758444 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:10.764288 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:10.764761 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:10.765189 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:10.765925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:10.766468 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:10.766890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:10.781326 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] HTTP exception thrown: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Request method failure captured: Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 HTTP/1.1 Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpYC2BUnG4ObdHzyWGzWkBLMhja9vEdOfbzpI18tEBYbvfYTNyb-DEZYbnieVgFuBNRIHKd1ctD20-7k278JLkDda5yjGCYJwdWjOeCHEsDnrRmlmpFmlEyYUxk8JWq2uDT7eOjTxFnG9dPc9dPHz_S0FyoBN96cTJr9P49Ldfp3GM Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:10.783445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: 56c86f73f98a4fb2af787534fd47e2ed Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.785085 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '1e74e585-b622-4beb-bc2c-f71b2be5e2f7'} Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:10.785996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.787504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.789240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Returning 404 to user: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:10.789240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d4a543b9-60da-45f1-bd68-17b44437eeed tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 404 len: 111 microversion: 2.1 time: 0.030678 Oct 06 04:43:10.789240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 580/1152] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:43:10 2022] DELETE /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:10.793151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:10.793768 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: 1e74e585-b622-4beb-bc2c-f71b2be5e2f7] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:10.800905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:10.801393 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:10.801832 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:10.802532 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:10.803231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:10.803665 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:10.817282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] HTTP exception thrown: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Request method failure captured: Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 HTTP/1.1 Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpYC2BUnG4ObdHzyWGzWkBLMhja9vEdOfbzpI18tEBYbvfYTNyb-DEZYbnieVgFuBNRIHKd1ctD20-7k278JLkDda5yjGCYJwdWjOeCHEsDnrRmlmpFmlEyYUxk8JWq2uDT7eOjTxFnG9dPc9dPHz_S0FyoBN96cTJr9P49Ldfp3GM Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:10.818793 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 56c86f73f98a4fb2af787534fd47e2ed Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.820396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '1e74e585-b622-4beb-bc2c-f71b2be5e2f7'} Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:10.821220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. Oct 06 04:43:10.822468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:10.823643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Returning 404 to user: Instance 1e74e585-b622-4beb-bc2c-f71b2be5e2f7 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:10.823643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6b1fefc2-a563-451c-abf6-3b58f1f2e9b7 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7" status: 404 len: 111 microversion: 2.1 time: 0.030845 Oct 06 04:43:10.823643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 573/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:10 2022] GET /compute/v2.1/servers/1e74e585-b622-4beb-bc2c-f71b2be5e2f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:43:11.961728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:11.962262 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:11.968276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:11.969766 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:11.970276 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:11.971049 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:11.971511 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:11.972055 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:11.987514 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] HTTP exception thrown: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Request method failure captured: Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: DELETE /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d HTTP/1.1 Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpYC2BUnG4ObdHzyWGzWkBLMhja9vEdOfbzpI18tEBYbvfYTNyb-DEZYbnieVgFuBNRIHKd1ctD20-7k278JLkDda5yjGCYJwdWjOeCHEsDnrRmlmpFmlEyYUxk8JWq2uDT7eOjTxFnG9dPc9dPHz_S0FyoBN96cTJr9P49Ldfp3GM Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:11.989493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: 56c86f73f98a4fb2af787534fd47e2ed Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:11.991060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': 'dc52256a-9199-4650-94d2-898dc19ce71d'} Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:11.991895 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:11.993427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:11.995166 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Returning 404 to user: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:11.995166 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-06c22d43-14ed-4f49-90b3-22820c6613e1 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 404 len: 111 microversion: 2.1 time: 0.034308 Oct 06 04:43:11.997924 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 581/1154] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:43:11 2022] DELETE /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:12.004766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:12.005897 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] [instance: dc52256a-9199-4650-94d2-898dc19ce71d] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:12.014039 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:12.015053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:12.015183 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:12.016393 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:12.016851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:12.017281 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:12.032572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] HTTP exception thrown: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Request method failure captured: Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d HTTP/1.1 Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpYC2BUnG4ObdHzyWGzWkBLMhja9vEdOfbzpI18tEBYbvfYTNyb-DEZYbnieVgFuBNRIHKd1ctD20-7k278JLkDda5yjGCYJwdWjOeCHEsDnrRmlmpFmlEyYUxk8JWq2uDT7eOjTxFnG9dPc9dPHz_S0FyoBN96cTJr9P49Ldfp3GM Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:12.034098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53abe2cc7a94ddaadb68b26b57faf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: f53abe2cc7a94ddaadb68b26b57faf69 Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415582161 Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 56c86f73f98a4fb2af787534fd47e2ed Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeTestJSON-1415582161-project Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:12.035714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'dc52256a-9199-4650-94d2-898dc19ce71d'} Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:12.036548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. Oct 06 04:43:12.037778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:12.038867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] Returning 404 to user: Instance dc52256a-9199-4650-94d2-898dc19ce71d could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:12.038867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-cbd241e7-7013-4eb2-8dcc-041133f8bc46 tempest-AttachVolumeTestJSON-1415582161 tempest-AttachVolumeTestJSON-1415582161-project] 10.222.0.33 "GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d" status: 404 len: 111 microversion: 2.1 time: 0.035729 Oct 06 04:43:12.038867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 574/1155] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:43:11 2022] GET /compute/v2.1/servers/dc52256a-9199-4650-94d2-898dc19ce71d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:43:16.227018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7e16f659-e5de-4d25-9766-118254180a34 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c42ba5940>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:16.275311 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7e16f659-e5de-4d25-9766-118254180a34 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1fcd79c6-899d-400c-ab34-3c3934051046" status: 200 len: 350 microversion: 2.1 time: 0.051867 Oct 06 04:43:16.275755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 582/1156] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:43:16 2022] GET /compute/v2.1/os-volumes/1fcd79c6-899d-400c-ab34-3c3934051046 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:17.640506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8a1f68c2-7f77-4a4b-8bb9-ae327bbd1def tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c42ac7280>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:17.692928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8a1f68c2-7f77-4a4b-8bb9-ae327bbd1def tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1fa4fb55-0d42-4bb3-b1f8-29596a7e3e1e" status: 200 len: 351 microversion: 2.1 time: 0.056045 Oct 06 04:43:17.693518 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 575/1157] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:43:17 2022] GET /compute/v2.1/os-volumes/1fa4fb55-0d42-4bb3-b1f8-29596a7e3e1e => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:19.050356 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-411364ed-233a-4355-8459-c1c2e04a0767 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c42e850d0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.106728 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-411364ed-233a-4355-8459-c1c2e04a0767 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8df3fa62-1cd0-467e-9ee3-8b1c73e275d8" status: 200 len: 350 microversion: 2.1 time: 0.060747 Oct 06 04:43:19.107971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 583/1158] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes/8df3fa62-1cd0-467e-9ee3-8b1c73e275d8 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:19.122698 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d5f603f5-d40d-46d2-b0bf-afe1e6d58f82 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c42b79820>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.206625 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d5f603f5-d40d-46d2-b0bf-afe1e6d58f82 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088392 Oct 06 04:43:19.207435 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 576/1159] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:19.228854 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8b77b8fc-d5dd-4b6a-9a26-f5cc9a150316 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c429c0280>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.313810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8b77b8fc-d5dd-4b6a-9a26-f5cc9a150316 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094903 Oct 06 04:43:19.314549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 584/1160] 10.222.0.33 () {58 vars in 1149 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:19.329199 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7c9b82e2-56b4-4cb2-993f-e08f880387bf tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c42b92040>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.414285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7c9b82e2-56b4-4cb2-993f-e08f880387bf tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089660 Oct 06 04:43:19.415100 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 577/1161] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:43:19.430588 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-41cf8356-ca96-486c-8c3d-8a5b40ebe757 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c429985e0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.516260 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-41cf8356-ca96-486c-8c3d-8a5b40ebe757 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088893 Oct 06 04:43:19.516888 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 585/1162] 10.222.0.33 () {58 vars in 1167 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:19.531736 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-80ab2469-9c9c-4943-824d-52cc888ff31a tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c42e25f70>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.622061 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-80ab2469-9c9c-4943-824d-52cc888ff31a tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094625 Oct 06 04:43:19.622642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 578/1163] 10.222.0.33 () {58 vars in 1170 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:19.637337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-dbf7c1ca-5236-4aa4-aed7-683bb0773599 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c429c0670>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.723580 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-dbf7c1ca-5236-4aa4-aed7-683bb0773599 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090650 Oct 06 04:43:19.724467 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 586/1164] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:19.738056 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8c4e9013-b400-4176-b6d2-3474e4c02d62 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c42ba3f70>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.823034 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8c4e9013-b400-4176-b6d2-3474e4c02d62 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089232 Oct 06 04:43:19.824094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 579/1165] 10.222.0.33 () {58 vars in 1188 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:19.837471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d1c5a9f6-dee1-49b5-81c0-bf39c1c9f801 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] Calling method '.version_select at 0x7f0c42e85d30>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:19.921053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d1c5a9f6-dee1-49b5-81c0-bf39c1c9f801 tempest-VolumesTestJSON-682465500 tempest-VolumesTestJSON-682465500-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087260 Oct 06 04:43:19.922217 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 587/1166] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Oct 6 04:43:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:35.232141 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:35.232891 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:35.237635 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:35.240292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:35.248716 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:35.249202 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:35.249627 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:35.250324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:35.250780 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:35.251246 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:35.281781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7f7b0e59-b27f-4a08-baa2-b52c09a6f6b0 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050000 Oct 06 04:43:35.282332 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 580/1167] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Oct 6 04:43:35 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:43:35.347856 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:35.349301 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:43:35.354521 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:35.355047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:35.364408 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:35.365027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:35.365660 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:35.366364 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:35.366822 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:35.367305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:35.398711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:43:35.490281 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d5901736-a8bf-45bd-a74d-555a184bbe73 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 204 len: 0 microversion: 2.20 time: 0.144104 Oct 06 04:43:35.491092 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 588/1168] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Oct 6 04:43:35 2022] DELETE /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 04:43:35.501886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:35.502508 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:35.508598 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:35.509515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:35.510275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:35.511077 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:35.511699 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:35.512353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:35.674493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:35.683526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:35.684966 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:35.686132 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-73349902-2d7e-46b6-bb2d-d87edf29b093 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.189518 Oct 06 04:43:35.686690 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 581/1169] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:43:35 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:43:36.712968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:36.713697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:36.721089 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:36.721576 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:36.722006 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:36.722697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:36.723192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:36.723616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:36.870167 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:36.879675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:36.880375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:36.881540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c1982161-2e2d-4637-b93f-fb5e41cb79ce tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1726 microversion: 2.20 time: 0.173209 Oct 06 04:43:36.882441 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 589/1170] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:43:36 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:43:37.908396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:37.909011 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:37.918734 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:37.919261 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:37.919702 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:37.920423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:37.921025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:37.921548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:37.995781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:38.008989 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:38.010736 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd574235b791e485aa64130c599539945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594a13a702cf47898a48ab4fd6789359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:43:38.012107 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-fbd5ef39-5ab7-429d-9aa2-4906ea0e6b19 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 200 len: 1658 microversion: 2.20 time: 0.107914 Oct 06 04:43:38.027072 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 582/1171] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:43:37 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 1658 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 04:43:38.052086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-ce383806-e212-4f99-bea5-24ba6e22691b req-09dcac52-b312-417f-8e99-372dc06b1f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40", "name": "network-vif-deleted", "tag": "e7a92c66-1f21-4c39-8bbe-215d0840346a"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:43:38.063123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ce383806-e212-4f99-bea5-24ba6e22691b req-09dcac52-b312-417f-8e99-372dc06b1f03 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:38.063798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ce383806-e212-4f99-bea5-24ba6e22691b req-09dcac52-b312-417f-8e99-372dc06b1f03 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:38.064337 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-ce383806-e212-4f99-bea5-24ba6e22691b req-09dcac52-b312-417f-8e99-372dc06b1f03 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:38.076140 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-ce383806-e212-4f99-bea5-24ba6e22691b req-09dcac52-b312-417f-8e99-372dc06b1f03 service nova] Creating event network-vif-deleted:e7a92c66-1f21-4c39-8bbe-215d0840346a for instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 on hv-cinder-86022 Oct 06 04:43:38.081886 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-ce383806-e212-4f99-bea5-24ba6e22691b req-09dcac52-b312-417f-8e99-372dc06b1f03 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Oct 06 04:43:38.082696 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 590/1172] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:43:39.046185 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:39.051186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:39.062286 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:39.063815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:39.064681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:39.065907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:39.066591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:39.067344 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:39.089223 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] HTTP exception thrown: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Request method failure captured: Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 HTTP/1.1 Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpZ3cZFMm3st8zDeTCQAZb6soIpE8Q4yQm5eMUKICGtqVsK-PglDOrIPpcG1KQzxb0A-Ax0OLCAsHncavzmo-ujcqVax_qtgW_ogElVA275opERWW7ix5gabXicZBmEk4IsA2f3_sVWpTrvvFMZHORLYU04e08JKdz0KX5VMvjrBNA Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:39.090983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_594a13a702cf47898a48ab4fd6789359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: d574235b791e485aa64130c599539945 Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:39.092514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40'} Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:39.093310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:39.094792 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:39.097582 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Returning 404 to user: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:39.098677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1abd5c08-c30b-4b58-84a3-8c75613858b1 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 404 len: 111 microversion: 2.20 time: 0.059666 Oct 06 04:43:39.103624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 583/1173] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:43:39 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:43:39.109271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-81f899c1-c7c8-4744-a204-3e21fca4edfc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '.version_select at 0x7f0c42c1b160>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:39.131344 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-81f899c1-c7c8-4744-a204-3e21fca4edfc tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092163188" status: 204 len: 0 microversion: 2.20 time: 0.026466 Oct 06 04:43:39.132049 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 591/1174] 10.222.0.33 () {60 vars in 1262 bytes} [Thu Oct 6 04:43:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092163188 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 06 04:43:41.047742 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:41.048251 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:41.056839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:41.057849 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:41.058701 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:41.059633 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:41.060254 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:41.060840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:41.080473 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] HTTP exception thrown: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Request method failure captured: Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: DELETE /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 HTTP/1.1 Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpZ3cZFMm3st8zDeTCQAZb6soIpE8Q4yQm5eMUKICGtqVsK-PglDOrIPpcG1KQzxb0A-Ax0OLCAsHncavzmo-ujcqVax_qtgW_ogElVA275opERWW7ix5gabXicZBmEk4IsA2f3_sVWpTrvvFMZHORLYU04e08JKdz0KX5VMvjrBNA Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:41.082313 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_594a13a702cf47898a48ab4fd6789359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: d574235b791e485aa64130c599539945 Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.083976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40'} Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:41.084886 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.086362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.089747 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Returning 404 to user: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:41.090907 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-87e11004-5ed9-42d6-bf9b-1c07f27a62da tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 404 len: 111 microversion: 2.20 time: 0.049380 Oct 06 04:43:41.092909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 584/1175] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Oct 6 04:43:41 2022] DELETE /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:43:41.102008 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:41.103331 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:41.112065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:41.112547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:41.112978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:41.113667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:41.114113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:41.114535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:41.130756 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] HTTP exception thrown: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Request method failure captured: Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 HTTP/1.1 Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpZ3cZFMm3st8zDeTCQAZb6soIpE8Q4yQm5eMUKICGtqVsK-PglDOrIPpcG1KQzxb0A-Ax0OLCAsHncavzmo-ujcqVax_qtgW_ogElVA275opERWW7ix5gabXicZBmEk4IsA2f3_sVWpTrvvFMZHORLYU04e08JKdz0KX5VMvjrBNA Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:41.132449 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_594a13a702cf47898a48ab4fd6789359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: d574235b791e485aa64130c599539945 Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.134136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40'} Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:41.135705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. Oct 06 04:43:41.137318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:41.138734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Returning 404 to user: Instance 2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:41.138734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-01e19ada-f84d-4231-8f13-0bf2639258e7 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40" status: 404 len: 111 microversion: 2.20 time: 0.036905 Oct 06 04:43:41.138734 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 592/1176] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:43:41 2022] GET /compute/v2.1/servers/2b9a9bb4-0f4c-42b9-889e-ccb15edcbd40 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:43:42.318597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:42.319717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:42.325894 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:42.326552 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:42.327186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:42.327900 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:42.329445 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:42.330059 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:42.344834 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] HTTP exception thrown: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Request method failure captured: Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: DELETE /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c HTTP/1.1 Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPlpZ3cZFMm3st8zDeTCQAZb6soIpE8Q4yQm5eMUKICGtqVsK-PglDOrIPpcG1KQzxb0A-Ax0OLCAsHncavzmo-ujcqVax_qtgW_ogElVA275opERWW7ix5gabXicZBmEk4IsA2f3_sVWpTrvvFMZHORLYU04e08JKdz0KX5VMvjrBNA Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:43:42.346404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_594a13a702cf47898a48ab4fd6789359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: d574235b791e485aa64130c599539945 Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.348081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '74c46bbc-e699-4b17-99e5-d6a70df92e2c'} Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:42.349113 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.350674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.352544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Returning 404 to user: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:42.352544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-69ea95f5-b301-4676-864b-742e6603b220 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "DELETE /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 404 len: 111 microversion: 2.20 time: 0.033048 Oct 06 04:43:42.352544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 585/1177] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Oct 6 04:43:42 2022] DELETE /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:43:42.356575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:43:42.357190 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] [instance: 74c46bbc-e699-4b17-99e5-d6a70df92e2c] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:43:42.364571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:42.365066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:42.365504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:42.366240 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:43:42.366690 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:43:42.367155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:43:42.385722 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] HTTP exception thrown: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Request method failure captured: Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c HTTP/1.1 Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPlpZ3cZFMm3st8zDeTCQAZb6soIpE8Q4yQm5eMUKICGtqVsK-PglDOrIPpcG1KQzxb0A-Ax0OLCAsHncavzmo-ujcqVax_qtgW_ogElVA275opERWW7ix5gabXicZBmEk4IsA2f3_sVWpTrvvFMZHORLYU04e08JKdz0KX5VMvjrBNA Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:43:42.387313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_594a13a702cf47898a48ab4fd6789359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/594a13a702cf47898a48ab4fd6789359"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: 594a13a702cf47898a48ab4fd6789359 Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1100922708 Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: d574235b791e485aa64130c599539945 Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1100922708-project Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.388849 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '74c46bbc-e699-4b17-99e5-d6a70df92e2c'} Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:43:42.389648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. Oct 06 04:43:42.391116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:43:42.392368 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] Returning 404 to user: Instance 74c46bbc-e699-4b17-99e5-d6a70df92e2c could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:43:42.392368 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-cf53ed3d-66f8-4bf2-94a4-464da518f278 tempest-AttachVolumeShelveTestJSON-1100922708 tempest-AttachVolumeShelveTestJSON-1100922708-project] 10.222.0.33 "GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c" status: 404 len: 111 microversion: 2.20 time: 0.036190 Oct 06 04:43:42.392368 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 593/1178] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Oct 6 04:43:42 2022] GET /compute/v2.1/servers/74c46bbc-e699-4b17-99e5-d6a70df92e2c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 04:43:51.285612 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-307a9457-58c8-4e4c-833d-3bc6b60e888e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Action: 'create', calling method: .version_select at 0x7f0c42bed5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-3162771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJNc/IBexxgxvvx7tA6/UIszyrM5iR0Ghcr5v4nPZz+5EX41jdPimXpfw+92iJmOtP62i+gD50fru+G7Xl0ZZ82iJlt521J19pv4GfbX5r5rr7j1dBKwn47Me1a591n4Q=="}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:43:51.301500 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-307a9457-58c8-4e4c-833d-3bc6b60e888e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Getting quotas for project 0a6698bc3af34041bd01a5d5abefb11c. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:43:51.305642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-307a9457-58c8-4e4c-833d-3bc6b60e888e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Getting quotas for user 040bc65ba7f94c14999a98266ff0ce7f and project 0a6698bc3af34041bd01a5d5abefb11c. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:43:51.332062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-307a9457-58c8-4e4c-833d-3bc6b60e888e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.273782 Oct 06 04:43:51.332814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 586/1179] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:43:51 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:44:23.601129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2040771542", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-3162771", "security_groups": [{"name": "tempest-secgroup-smoke-284699966"}], "networks": [{"uuid": "36e4c5e7-9f6e-42e8-9c59-1b6fb09c680b"}], "block_device_mapping_v2": [{"uuid": "411f35a8-d90b-4e9b-b84d-e8f4104cb2c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:44:23.611694 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:23.612493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:23.724023 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] validate_networks() for [('36e4c5e7-9f6e-42e8-9c59-1b6fb09c680b', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:44:24.231513 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:44:24.231939 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:44:24.232446 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:44:24.232863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:44:24.233274 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:44:24.242534 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:24.243053 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:24.243493 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:24.244227 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:24.244977 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:24.245403 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:24.262387 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Getting quotas for project 0a6698bc3af34041bd01a5d5abefb11c. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:44:24.266406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Getting quotas for user 040bc65ba7f94c14999a98266ff0ce7f and project 0a6698bc3af34041bd01a5d5abefb11c. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:44:24.326724 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:44:24.329054 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='411f35a8-d90b-4e9b-b84d-e8f4104cb2c5',volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:44:24.460010 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-52c0b563-d659-4e2f-9ec2-5f77514296cc tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.862824 Oct 06 04:44:24.465855 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 594/1180] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:44:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:44:24.468994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=24 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:24.469839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=4 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:24.470863 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:24.473493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 04:44:24.473753 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Thu Oct 6 04:44:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd (ip 10.222.0.33) !!! Oct 06 04:44:24.478367 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2c24f88b-d284-4620-814a-2cac0e87c378 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:24.479002 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2c24f88b-d284-4620-814a-2cac0e87c378 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:24.548324 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2c24f88b-d284-4620-814a-2cac0e87c378 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:24.556006 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2c24f88b-d284-4620-814a-2cac0e87c378 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1086 microversion: 2.1 time: 0.088188 Oct 06 04:44:24.556563 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 587/1181] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:24 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1086 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:25.580393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:25.580988 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:25.588884 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:25.589366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:25.589796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:25.590481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:25.590931 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:25.591376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:25.658349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:25.666227 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-e69d7732-9576-4513-86f0-3314578e6fff tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1184 microversion: 2.1 time: 0.091259 Oct 06 04:44:25.667015 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 595/1182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:25 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1184 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:26.693516 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:26.694534 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:26.703481 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:26.704134 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:26.704690 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:26.705562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:26.706308 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:26.707106 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:26.878343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:26.886877 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e3f98c61-d671-4378-9c71-a15c3e97f52f tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1269 microversion: 2.1 time: 0.200475 Oct 06 04:44:26.887500 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 588/1183] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:26 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1269 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:27.567375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-bd25c3b8-15a8-4df7-9f37-73cb106cc5d2 req-3270c216-cf31-4f29-8682-43f94fcccddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a05af87-4c0b-4f25-9c50-6d3cedb63acd", "tag": "795d6dcc-3910-4da6-b102-5089193d5016"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:44:27.578067 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-bd25c3b8-15a8-4df7-9f37-73cb106cc5d2 req-3270c216-cf31-4f29-8682-43f94fcccddb service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:27.578547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-bd25c3b8-15a8-4df7-9f37-73cb106cc5d2 req-3270c216-cf31-4f29-8682-43f94fcccddb service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:27.578995 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-bd25c3b8-15a8-4df7-9f37-73cb106cc5d2 req-3270c216-cf31-4f29-8682-43f94fcccddb service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:27.590824 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-bd25c3b8-15a8-4df7-9f37-73cb106cc5d2 req-3270c216-cf31-4f29-8682-43f94fcccddb service nova] Creating event network-changed:795d6dcc-3910-4da6-b102-5089193d5016 for instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd on hv-cinder-86022 Oct 06 04:44:27.595864 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-bd25c3b8-15a8-4df7-9f37-73cb106cc5d2 req-3270c216-cf31-4f29-8682-43f94fcccddb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156572 Oct 06 04:44:27.596457 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 596/1184] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:44:27.909743 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:27.910360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:27.917648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:27.918185 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:27.918678 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:27.919398 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:27.919860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:27.920333 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:28.061795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:28.070642 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f8c6ae37-393b-4c1f-8124-3407a621d3a5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.164698 Oct 06 04:44:28.075276 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 589/1185] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:27 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:29.095373 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:29.096084 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:29.107311 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:29.108357 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:29.108922 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:29.110132 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:29.111154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:29.112432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:29.265720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:29.273688 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b7e344e7-3215-407e-9edb-12a4228bae1b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.183343 Oct 06 04:44:29.274356 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 597/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:29 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:30.296115 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:30.296748 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:30.303125 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:30.304287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:30.305000 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:30.306140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:30.307038 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:30.307720 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:30.448072 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:30.456662 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-562568b4-7a2e-4510-bfc0-1f172b7a0dc1 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.164451 Oct 06 04:44:30.457228 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 590/1187] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:30 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:31.485953 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:31.486481 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:31.492683 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:31.493157 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:31.493586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:31.494266 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:31.494979 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:31.495410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:31.624427 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:31.632506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8b5b0808-f7f1-4dc7-8dd3-ea45728aa14a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.150683 Oct 06 04:44:31.633150 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 598/1188] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:31 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:32.655951 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:32.656575 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:32.664093 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:32.664592 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:32.665040 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:32.665758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:32.666218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:32.666648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:32.880095 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:32.894031 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-aa724b86-b786-43d1-82d6-d472b8b17df3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.241970 Oct 06 04:44:32.896918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 591/1189] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:32 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:33.918043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:33.918639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:33.925249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:33.925741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:33.926148 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:33.926834 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:33.927667 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:33.928093 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:34.075284 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:34.095016 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-88318951-38a8-4ffe-9827-fc857f03edb3 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.180858 Oct 06 04:44:34.095592 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 599/1190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:33 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:35.118449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:35.119186 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:35.121979 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:35.127543 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:35.128187 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:35.128798 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:35.129593 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:35.130009 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:35.130473 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:35.281660 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:35.289548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-d09a4b0f-d950-4285-beb9-c7a7747efd96 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.175894 Oct 06 04:44:35.290316 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 592/1191] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:35 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:44:36.312271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:36.312903 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:36.314890 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:36.315576 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:44:36.321921 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:36.322407 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:36.322850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:36.323575 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:36.324026 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:36.324450 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:36.463707 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:36.474162 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-65e4ec25-0217-41f1-8fcc-0047b5fc7507 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.165671 Oct 06 04:44:36.474749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 600/1192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:36 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:37.496961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:37.497568 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:37.503868 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:37.504357 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:37.504791 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:37.505489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:37.505940 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:37.506441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:37.642941 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:37.651081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-b54845b0-2f38-4889-b796-24dcce83d994 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.158128 Oct 06 04:44:37.651707 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 593/1193] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:37 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:38.674143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:38.674745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:38.681679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:38.682167 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:38.682607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:38.683333 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:38.683788 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:38.684218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:38.818529 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:38.827002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4ab3e982-34e3-4909-b03e-718a4bca0bad tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.156757 Oct 06 04:44:38.827578 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 601/1194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:38 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:39.781349 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-9efa3d27-a431-4a59-8a82-7e135079eb08 req-9492667c-d7d7-4849-8b3f-aa090802b488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a05af87-4c0b-4f25-9c50-6d3cedb63acd", "name": "network-vif-plugged", "status": "completed", "tag": "795d6dcc-3910-4da6-b102-5089193d5016"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:44:39.790583 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-9efa3d27-a431-4a59-8a82-7e135079eb08 req-9492667c-d7d7-4849-8b3f-aa090802b488 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:39.791088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-9efa3d27-a431-4a59-8a82-7e135079eb08 req-9492667c-d7d7-4849-8b3f-aa090802b488 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:39.791517 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-9efa3d27-a431-4a59-8a82-7e135079eb08 req-9492667c-d7d7-4849-8b3f-aa090802b488 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:39.801867 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-9efa3d27-a431-4a59-8a82-7e135079eb08 req-9492667c-d7d7-4849-8b3f-aa090802b488 service nova] Creating event network-vif-plugged:795d6dcc-3910-4da6-b102-5089193d5016 for instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd on hv-cinder-86022 Oct 06 04:44:39.806924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-9efa3d27-a431-4a59-8a82-7e135079eb08 req-9492667c-d7d7-4849-8b3f-aa090802b488 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151834 Oct 06 04:44:39.807512 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 594/1195] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:44:39.849572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:39.850195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:39.856706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:39.857212 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:39.857643 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:39.858330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:39.858807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:39.859252 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:39.989324 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:39.997617 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9f417865-fa98-4207-b8c0-e9eb2fc0bd8c tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.151843 Oct 06 04:44:39.998178 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 602/1196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:39 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:41.023719 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:41.026032 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:41.034511 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:41.035045 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:41.035484 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:41.036191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:41.036648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:41.037075 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:41.174196 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:41.182406 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-760be994-92a5-430e-9f0d-378048b44945 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.165559 Oct 06 04:44:41.182981 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 595/1197] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:41 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:42.205082 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:42.206468 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:42.217666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:42.218670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:42.218772 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:42.219445 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:42.219894 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:42.220316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:42.356974 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:42.365153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-00cc717d-31d2-4c8c-bbb7-f21072e67085 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.164142 Oct 06 04:44:42.366261 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 603/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:42 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:43.389142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:43.389842 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:43.396665 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:43.397799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:43.398311 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:43.399376 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:43.399924 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:43.400432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:43.539575 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:43.547396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-797a6c4f-56fd-4838-9fd6-54858eef06c4 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.162282 Oct 06 04:44:43.547977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 596/1199] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:43 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:44.570143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:44.570749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:44.576874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:44.577348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:44.577776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:44.578463 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:44.578907 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:44.579349 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:44.722081 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:44.733703 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-febd3ec2-bab5-42a4-be7b-20a14891ffdf tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.168022 Oct 06 04:44:44.734336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 604/1200] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:44 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:45.758041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:45.758684 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:45.765133 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:45.765610 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:45.766040 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:45.766765 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:45.767255 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:45.767681 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:45.900409 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:45.908006 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6ed34f0c-351b-4368-b487-41de97257910 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1257 microversion: 2.1 time: 0.154566 Oct 06 04:44:45.908564 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 597/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:45 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:46.929758 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:46.930362 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:46.936865 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:46.937344 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:46.937773 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:46.938455 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:46.938952 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:46.939404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:47.072810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:47.080597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d3d01fc8-eb2c-4148-8234-d402a78236ec tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1440 microversion: 2.1 time: 0.154817 Oct 06 04:44:47.081163 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 605/1202] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:46 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1440 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:47.103171 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:44:47.103778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:44:47.110062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:47.110549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:47.111010 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:47.111717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:47.112171 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:47.112711 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:47.250547 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:44:47.258813 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5eda7bdd-9402-44cb-be42-53c38272b340 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1440 microversion: 2.1 time: 0.159592 Oct 06 04:44:47.259439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 598/1203] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:44:47 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1440 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:44:49.051179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-5814d591-9c08-4420-8034-878ce7fa0d99 req-5f77910b-a5d1-49e8-8114-3e5cf83aff87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a05af87-4c0b-4f25-9c50-6d3cedb63acd", "tag": "795d6dcc-3910-4da6-b102-5089193d5016"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:44:49.066538 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5814d591-9c08-4420-8034-878ce7fa0d99 req-5f77910b-a5d1-49e8-8114-3e5cf83aff87 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:44:49.067244 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5814d591-9c08-4420-8034-878ce7fa0d99 req-5f77910b-a5d1-49e8-8114-3e5cf83aff87 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:44:49.067730 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-5814d591-9c08-4420-8034-878ce7fa0d99 req-5f77910b-a5d1-49e8-8114-3e5cf83aff87 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:44:49.080874 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-5814d591-9c08-4420-8034-878ce7fa0d99 req-5f77910b-a5d1-49e8-8114-3e5cf83aff87 service nova] Creating event network-changed:795d6dcc-3910-4da6-b102-5089193d5016 for instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd on hv-cinder-86022 Oct 06 04:44:49.087814 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-5814d591-9c08-4420-8034-878ce7fa0d99 req-5f77910b-a5d1-49e8-8114-3e5cf83aff87 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040267 Oct 06 04:44:49.089535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 606/1204] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:45:35.379748 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=26 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:35.381693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=62 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:45:35.623697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-14b715fb-ccc3-4d34-8a2e-638927d820af tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Action: 'create', calling method: .version_select at 0x7f0c42904280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-794825599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqsumdHoGunPy2E8cg8+FJf6DYVqkmlFSi0ldLjWUCorR1w8yilBvcgMhEDKUY1P61u2duer47l6E6SDxQMGgJWU5fDXYhSIwo5M+byV98c/azfztcP6BXmVHdcdk4QHQ=="}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:45:35.645071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-14b715fb-ccc3-4d34-8a2e-638927d820af tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Getting quotas for project a707ca1042dd4fc99ff1dbd033efe0e8. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:45:35.650321 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-14b715fb-ccc3-4d34-8a2e-638927d820af tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Getting quotas for user 450dcd00d2404852b9635e72650d0c7f and project a707ca1042dd4fc99ff1dbd033efe0e8. Resources: {'key_pairs'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:45:35.676857 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-14b715fb-ccc3-4d34-8a2e-638927d820af tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.307897 Oct 06 04:45:35.677556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 599/1205] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Oct 6 04:45:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:46:00.616962 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:00.617753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=66 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:00.623061 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1931226825", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-794825599", "security_groups": [{"name": "tempest-secgroup-smoke-1871208602"}], "block_device_mapping_v2": [{"uuid": "b4853b3b-6781-447b-b412-6b66fc4cab7e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b5b78c7d-20eb-423c-ac79-d8c29b70489b"}]}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:46:00.739804 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] validate_networks() for [('b5b78c7d-20eb-423c-ac79-d8c29b70489b', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:46:01.133631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:46:01.134047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:46:01.134511 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:46:01.134909 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:46:01.135341 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:46:01.144291 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:01.144764 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:01.145192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:01.145931 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:01.146376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:01.146790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:01.162997 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Getting quotas for project a707ca1042dd4fc99ff1dbd033efe0e8. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:46:01.166853 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Getting quotas for user 450dcd00d2404852b9635e72650d0c7f and project a707ca1042dd4fc99ff1dbd033efe0e8. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:46:01.224377 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:46:01.226605 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4853b3b-6781-447b-b412-6b66fc4cab7e',volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:46:01.355304 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-cda5748f-b0f4-4cfa-99c3-e336a19e1dcb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740380 Oct 06 04:46:01.355951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 607/1206] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:46:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:46:01.364586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=4 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:01.365675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:01.369805 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2730a85a-5d99-44b8-adc5-b5b36d3f24af tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:01.372005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2730a85a-5d99-44b8-adc5-b5b36d3f24af tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:01.427343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2730a85a-5d99-44b8-adc5-b5b36d3f24af tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:01.439045 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2730a85a-5d99-44b8-adc5-b5b36d3f24af tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1094 microversion: 2.1 time: 0.075949 Oct 06 04:46:01.451386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 600/1207] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:01 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:02.462784 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:02.463420 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:02.470011 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:02.470497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:02.470928 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:02.471721 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:02.472167 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:02.472586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:02.541365 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:02.549391 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a23a2d07-f312-4470-ba05-41eae142fc9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1192 microversion: 2.1 time: 0.090393 Oct 06 04:46:02.549944 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 608/1208] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:02 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:03.577535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:03.578231 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:03.599353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:03.600438 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:03.601821 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:03.603254 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:03.603890 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:03.605291 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:03.780222 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:03.788353 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8b460a24-47d1-4ee6-843b-bde94848d2e5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1278 microversion: 2.1 time: 0.219758 Oct 06 04:46:03.788889 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 601/1209] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:03 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:04.288127 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-2f09998c-708c-430c-9490-4c6868be190b req-81f2a363-cd67-44da-965d-3c129c906927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "645505a6-9888-4067-b2bf-3d9691760490", "tag": "f12fd7b5-725b-4edc-bd05-d5f51d5449b7"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:46:04.294537 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 04:46:04.294900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Thu Oct 6 04:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 06 04:46:04.302370 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2f09998c-708c-430c-9490-4c6868be190b req-81f2a363-cd67-44da-965d-3c129c906927 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:04.303001 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2f09998c-708c-430c-9490-4c6868be190b req-81f2a363-cd67-44da-965d-3c129c906927 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:04.303637 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-2f09998c-708c-430c-9490-4c6868be190b req-81f2a363-cd67-44da-965d-3c129c906927 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:04.320352 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-2f09998c-708c-430c-9490-4c6868be190b req-81f2a363-cd67-44da-965d-3c129c906927 service nova] Creating event network-changed:f12fd7b5-725b-4edc-bd05-d5f51d5449b7 for instance 645505a6-9888-4067-b2bf-3d9691760490 on hv-cinder-86022 Oct 06 04:46:04.326652 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-2f09998c-708c-430c-9490-4c6868be190b req-81f2a363-cd67-44da-965d-3c129c906927 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043453 Oct 06 04:46:04.327561 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 609/1210] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:46:04.813300 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:04.813910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:04.820615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:04.821096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:04.821528 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:04.822217 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:04.822671 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:04.823140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:04.955912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:04.963739 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1b20d4fc-f232-4f38-b999-1c4d5cd21335 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.154304 Oct 06 04:46:04.964386 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 602/1211] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:04 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:05.986942 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:05.987591 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:05.993869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:05.994406 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:05.994841 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:05.996378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:05.996922 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:05.997353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:06.230146 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:06.239381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ef116b96-2fe4-43f7-882e-df169ec8ff9e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.257097 Oct 06 04:46:06.239927 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 610/1212] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:05 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:07.264415 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:07.265036 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:07.271472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:07.271960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:07.272401 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:07.273108 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:07.273565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:07.274006 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:07.404500 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:07.412275 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ea68f1fd-e467-46a9-9993-42b89effc44c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.152303 Oct 06 04:46:07.413124 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 603/1213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:07 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:08.436095 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:08.437062 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:08.443401 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:08.443863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:08.444295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:08.444983 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:08.445431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:08.445848 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:08.584823 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:08.593019 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-26a2069b-e6d8-42b8-8776-5414e215c4dd tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.160951 Oct 06 04:46:08.593582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 611/1214] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:08 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:09.617021 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:09.617616 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:09.624094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:09.624572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:09.625005 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:09.625691 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:09.626144 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:09.626569 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:09.754709 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:09.762546 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c203b2f4-f4b8-47f7-9258-7a02e2095a6a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.149545 Oct 06 04:46:09.763128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 604/1215] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:09 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:10.785926 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:10.786538 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:10.793255 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:10.793770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:10.794265 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:10.795105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:10.795596 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:10.796081 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:10.928803 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:10.937419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9c1ae15f-b8ed-4da5-87a5-b611b2d547f1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.155408 Oct 06 04:46:10.937987 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 612/1216] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:10 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:11.960191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:11.960800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:11.963157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:11.968968 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:11.969448 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:11.969881 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:11.970569 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:11.971046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:11.971471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:12.103995 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:12.111579 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-311ca83b-c1d2-481c-b504-325954fbf4ab tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.155305 Oct 06 04:46:12.112136 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 605/1217] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:11 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:46:13.134075 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:13.134787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:13.137007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:13.137772 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=6 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:46:13.145900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:13.145900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:13.145900 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:13.146503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:13.146948 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:13.147392 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:13.284372 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:13.292806 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f4dd9456-7798-4e00-9240-79581301cbeb tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.161879 Oct 06 04:46:13.293385 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 613/1218] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:13 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:14.315550 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:14.316164 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:14.322488 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:14.323565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:14.324041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:14.324728 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:14.325175 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:14.325597 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:14.456122 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:14.464297 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3ed882ab-cbb2-4ecd-8da2-4606bb937f3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.152119 Oct 06 04:46:14.464856 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 606/1219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:14 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:15.279863 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-4ad7b899-ee70-4dc1-86bc-104713516a6c req-74bca9d2-dc7c-4416-ab2a-7b3865606a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645505a6-9888-4067-b2bf-3d9691760490", "name": "network-vif-plugged", "status": "completed", "tag": "f12fd7b5-725b-4edc-bd05-d5f51d5449b7"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:46:15.289991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-4ad7b899-ee70-4dc1-86bc-104713516a6c req-74bca9d2-dc7c-4416-ab2a-7b3865606a3d service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:15.290639 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-4ad7b899-ee70-4dc1-86bc-104713516a6c req-74bca9d2-dc7c-4416-ab2a-7b3865606a3d service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:15.290901 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-4ad7b899-ee70-4dc1-86bc-104713516a6c req-74bca9d2-dc7c-4416-ab2a-7b3865606a3d service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:15.302307 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-4ad7b899-ee70-4dc1-86bc-104713516a6c req-74bca9d2-dc7c-4416-ab2a-7b3865606a3d service nova] Creating event network-vif-plugged:f12fd7b5-725b-4edc-bd05-d5f51d5449b7 for instance 645505a6-9888-4067-b2bf-3d9691760490 on hv-cinder-86022 Oct 06 04:46:15.307918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-4ad7b899-ee70-4dc1-86bc-104713516a6c req-74bca9d2-dc7c-4416-ab2a-7b3865606a3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031200 Oct 06 04:46:15.308510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 614/1220] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:46:15.487379 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:15.487982 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:15.494330 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:15.495494 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:15.496287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:15.497392 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:15.498116 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:15.498782 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:15.636862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:15.644423 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f07b0865-34a6-44ea-950b-a620a7a8c6a8 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.161127 Oct 06 04:46:15.644985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 607/1221] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:15 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:16.670381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:16.671102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:16.677717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:16.678207 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:16.678644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:16.679567 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:16.680344 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:16.680931 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:16.821904 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:16.830280 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a56bdf5b-6da1-41a2-b4b3-d5f62a1f951d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1266 microversion: 2.1 time: 0.165395 Oct 06 04:46:16.830902 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 615/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:16 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:17.853743 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:17.854360 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:17.860954 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:17.861439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:17.861892 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:17.862580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:17.863074 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:17.863504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:17.992343 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:18.001282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a837399b-2826-41b4-a451-b24b1c87a321 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1453 microversion: 2.1 time: 0.151436 Oct 06 04:46:18.001884 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 608/1223] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:17 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:18.023813 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:46:18.024419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:46:18.030755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:18.031270 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:18.031702 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:18.032381 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:18.032828 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:18.033245 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:18.161600 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:46:18.170249 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-424fab7a-db29-4216-a668-cee294ae64e0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1453 microversion: 2.1 time: 0.150288 Oct 06 04:46:18.170827 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 616/1224] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:46:18 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:46:20.118861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-c0ad2de5-52cc-4e9e-a983-aba0b778038d req-a7799be3-448d-451c-a684-d67a8f55ef7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "645505a6-9888-4067-b2bf-3d9691760490", "tag": "f12fd7b5-725b-4edc-bd05-d5f51d5449b7"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:46:20.129661 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c0ad2de5-52cc-4e9e-a983-aba0b778038d req-a7799be3-448d-451c-a684-d67a8f55ef7b service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:46:20.130242 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c0ad2de5-52cc-4e9e-a983-aba0b778038d req-a7799be3-448d-451c-a684-d67a8f55ef7b service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:46:20.130742 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c0ad2de5-52cc-4e9e-a983-aba0b778038d req-a7799be3-448d-451c-a684-d67a8f55ef7b service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:46:20.142509 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-c0ad2de5-52cc-4e9e-a983-aba0b778038d req-a7799be3-448d-451c-a684-d67a8f55ef7b service nova] Creating event network-changed:f12fd7b5-725b-4edc-bd05-d5f51d5449b7 for instance 645505a6-9888-4067-b2bf-3d9691760490 on hv-cinder-86022 Oct 06 04:46:20.147622 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-c0ad2de5-52cc-4e9e-a983-aba0b778038d req-a7799be3-448d-451c-a684-d67a8f55ef7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032351 Oct 06 04:46:20.148212 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 609/1225] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:47:29.072996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:29.073749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=48 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:29.078017 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:47:29.078547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:29.085488 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:29.085972 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:29.086404 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:29.087662 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:29.088116 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:29.088532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:29.112081 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.objects.instance [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lazy-loading 'flavor' on Instance uuid 3a05af87-4c0b-4f25-9c50-6d3cedb63acd {{(pid=127098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 04:47:29.186570 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-75e64c76-4e67-42c4-8418-ccad91da31a2 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "POST /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd/action" status: 202 len: 0 microversion: 2.1 time: 0.115218 Oct 06 04:47:29.187196 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 617/1226] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:47:29 2022] POST /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:47:29.195382 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=22 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:29.196131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=50 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:29.201778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:29.202870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:29.212556 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:29.213046 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:29.213486 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:29.214191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:29.214646 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:29.215104 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:29.464000 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:29.471730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-345ad0ee-e720-4ae3-9b47-95325340cfa9 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.279341 Oct 06 04:47:29.472295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 610/1227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:29 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:30.494557 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:30.495532 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:30.502339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:30.502830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:30.503369 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:30.504080 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:30.504536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:30.504967 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:30.691541 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:30.699440 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8c01fd61-b417-4ce0-93f4-661d1f7bed19 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.209094 Oct 06 04:47:30.700007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 618/1228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:30 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:31.723751 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:31.724364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:31.731786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:31.732272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:31.732707 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:31.733405 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:31.733862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:31.734286 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:31.865644 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:31.873937 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-0438834b-6e12-4e82-bea6-6418ea3d2037 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.154072 Oct 06 04:47:31.874493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 611/1229] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:31 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:32.897158 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:32.897770 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:32.903996 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:32.904475 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:32.904902 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:32.905590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:32.906033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:32.906452 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:33.117531 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:33.126271 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8007676a-6164-4934-8612-5f5133866769 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.233350 Oct 06 04:47:33.126833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 619/1230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:32 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:47:34.148781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:34.150051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:34.156517 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:34.156999 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:34.157430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:34.158153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:34.158605 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:34.159055 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:34.293461 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:34.301190 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-81f2b3be-e884-4edf-8f67-6171770c024d tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.156247 Oct 06 04:47:34.301758 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 612/1231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:34 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:35.325506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:35.326115 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:35.332542 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:35.333022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:35.333488 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:35.334209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:35.334661 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:35.335134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:35.468251 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:35.475999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-5e9ec798-fa92-4070-b749-34dcb56c0e78 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.154899 Oct 06 04:47:35.476568 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 620/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:35 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:36.498376 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:36.499010 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:36.505479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:36.505961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:36.506399 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:36.507129 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:36.507589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:36.508016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:36.639490 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:36.647175 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-09dd107e-5e1b-44bb-81a7-e7bf85cf4930 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.152872 Oct 06 04:47:36.647745 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 613/1233] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:36 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:47:37.669747 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:37.670363 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:37.676810 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:37.677272 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:37.677729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:37.678417 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:37.678867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:37.679315 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:37.808641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:37.816409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2f96b3aa-f1e9-4735-ad91-b07cc8ad9bb5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.150494 Oct 06 04:47:37.816968 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 621/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:37 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:38.840817 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:38.841403 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:38.847497 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:38.847983 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:38.848412 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:38.849109 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:38.849560 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:38.849984 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:38.994025 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:39.001985 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c4fa0375-81df-4429-bd6d-e222faaaf396 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.165719 Oct 06 04:47:39.002549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 614/1235] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:38 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:40.027497 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:40.028239 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:40.034866 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:40.035383 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:40.035819 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:40.036514 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:40.036967 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:40.037389 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:40.173875 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:40.182058 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-0ddc0940-c978-4669-b1e7-594e843b6c69 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.159231 Oct 06 04:47:40.182627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 622/1236] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:40 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:41.204778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:41.205370 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:41.212215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:41.212704 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:41.213145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:41.213853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:41.214314 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:41.214740 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:41.346680 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:41.355328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-aad3a24e-7bb5-49c7-87d7-f811aebe663a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.154318 Oct 06 04:47:41.355901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 615/1237] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:41 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:42.380030 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:42.380807 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:42.388637 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:42.389111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:42.389540 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:42.390280 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:42.390855 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:42.391317 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:42.522526 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:42.531009 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1e5d94bd-90d7-4b31-8d50-b003a321a69e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1565 microversion: 2.1 time: 0.155159 Oct 06 04:47:42.531576 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 623/1238] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:42 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:42.553719 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:47:42.554310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:42.560657 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:42.561137 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:42.561572 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:42.562265 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:42.562722 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:42.563179 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:42.590915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127097) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 04:47:42.653823 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [dd79c952-b41b-4444-b0fb-8853f19c4a92] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 04:47:43.661023 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [dd79c952-b41b-4444-b0fb-8853f19c4a92] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 36668. Oct 06 04:47:43.664767 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-c2d95229-2310-4970-aad8-b9562f30d12b tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "POST /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd/action" status: 202 len: 0 microversion: 2.1 time: 1.114883 Oct 06 04:47:43.665829 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 616/1239] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Oct 6 04:47:42 2022] POST /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 04:47:43.673762 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:43.674385 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:43.680508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:43.680989 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:43.681510 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:43.682213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:43.682662 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:43.683305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:43.730125 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-b0f0c391-6a43-4bf5-9a22-7a18dba0a39b req-cb7ee349-aef1-4c06-8de5-c555a85405cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a05af87-4c0b-4f25-9c50-6d3cedb63acd", "name": "network-vif-unplugged", "status": "completed", "tag": "795d6dcc-3910-4da6-b102-5089193d5016"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:47:43.751229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b0f0c391-6a43-4bf5-9a22-7a18dba0a39b req-cb7ee349-aef1-4c06-8de5-c555a85405cf service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:43.752075 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b0f0c391-6a43-4bf5-9a22-7a18dba0a39b req-cb7ee349-aef1-4c06-8de5-c555a85405cf service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:43.752730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-b0f0c391-6a43-4bf5-9a22-7a18dba0a39b req-cb7ee349-aef1-4c06-8de5-c555a85405cf service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:43.763992 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.compute.server_external_events [req-b0f0c391-6a43-4bf5-9a22-7a18dba0a39b req-cb7ee349-aef1-4c06-8de5-c555a85405cf service nova] Unable to find a host for instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd. Dropping event network-vif-unplugged {{(pid=127097) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 04:47:43.764896 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-b0f0c391-6a43-4bf5-9a22-7a18dba0a39b req-cb7ee349-aef1-4c06-8de5-c555a85405cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039562 Oct 06 04:47:43.765799 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 617/1240] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 06 04:47:43.847069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:43.855454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9bfbc9ce-1cd1-4a58-b942-665e6f3b1796 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1513 microversion: 2.1 time: 0.185461 Oct 06 04:47:43.855958 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 624/1241] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:43 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:44.879136 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:44.879697 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:44.886523 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:44.887033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:44.887472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:44.888174 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:44.888630 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:44.889056 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:45.019652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:45.028611 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-be2fddb7-0d56-459a-a0dd-a43d1103c1be tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1515 microversion: 2.1 time: 0.153425 Oct 06 04:47:45.029215 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 618/1242] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:44 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:46.053648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:46.054257 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:46.062064 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:46.062547 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:46.062999 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:46.063720 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:46.064174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:46.064598 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:46.237920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:46.245993 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-faff76a8-da18-4b3f-ba18-c506f75f8bdb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.196231 Oct 06 04:47:46.246549 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 625/1243] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:46 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:47.268918 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:47.269463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:47.275960 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:47.276446 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:47.276882 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:47.277581 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:47.278035 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:47.278462 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:47.408693 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:47.418525 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-8349b5c0-c178-4211-8e41-8d9253277dae tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.152331 Oct 06 04:47:47.420421 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 619/1244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:47 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:48.443307 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:48.443915 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:48.451102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:48.451581 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:48.452022 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:48.452743 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:48.453192 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:48.453616 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:48.581246 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:48.589048 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f6cc859c-796e-4520-9a55-83232b49f0b6 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.149745 Oct 06 04:47:48.589613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 626/1245] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:48 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:49.612845 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:49.613510 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:49.620885 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:49.621378 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:49.621814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:49.622538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:49.623020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:49.623449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:49.757565 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:49.765959 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7e26b87e-3d47-4386-b78b-6f18bd757e03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.157100 Oct 06 04:47:49.766530 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 620/1246] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:49 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:50.789376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:50.790527 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:50.797021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:50.797506 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:50.797930 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:50.798613 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:50.799089 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:50.799507 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:50.925932 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:50.933612 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f91fde48-0db0-4039-b3f2-9b404070cf04 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.148100 Oct 06 04:47:50.934174 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 627/1247] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:50 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:51.956589 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:51.957226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:51.963727 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:51.964205 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:51.964636 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:51.965319 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:51.965771 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:51.966193 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:52.100815 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:52.109208 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-602e2ef3-6922-4141-9351-aa31735c382a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.156443 Oct 06 04:47:52.109775 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 621/1248] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:51 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:53.132775 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:53.133410 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:53.139790 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:53.140269 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:53.140694 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:53.141374 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:53.141820 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:53.142236 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:53.277047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:53.284658 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-1774a574-17b0-4821-bd96-d18062ff66b5 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.155843 Oct 06 04:47:53.285218 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 628/1249] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:53 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:54.308447 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:54.309067 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:54.315422 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:54.315909 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:54.316347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:54.317051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:54.317505 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:54.317928 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:54.451068 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:54.458675 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-76ccc9f2-5070-4912-b789-37cda330ae21 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.154780 Oct 06 04:47:54.459269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 622/1250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:54 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:55.481571 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:55.482170 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:55.488585 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:55.489067 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:55.489496 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:55.490182 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:55.490627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:55.491086 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:55.637181 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:55.644833 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f9a7293a-1636-465f-80b7-82c7a4524e34 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.167096 Oct 06 04:47:55.645399 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 629/1251] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:55 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:55.848345 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-6751a4a3-1d1c-4a8d-b00b-6564ad4b8b36 req-7e2100fe-bed4-4a4b-8da0-0df73228988b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a05af87-4c0b-4f25-9c50-6d3cedb63acd", "name": "network-vif-plugged", "status": "completed", "tag": "795d6dcc-3910-4da6-b102-5089193d5016"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:47:55.859936 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-6751a4a3-1d1c-4a8d-b00b-6564ad4b8b36 req-7e2100fe-bed4-4a4b-8da0-0df73228988b service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:55.860427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-6751a4a3-1d1c-4a8d-b00b-6564ad4b8b36 req-7e2100fe-bed4-4a4b-8da0-0df73228988b service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:55.860923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-6751a4a3-1d1c-4a8d-b00b-6564ad4b8b36 req-7e2100fe-bed4-4a4b-8da0-0df73228988b service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:55.874110 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-6751a4a3-1d1c-4a8d-b00b-6564ad4b8b36 req-7e2100fe-bed4-4a4b-8da0-0df73228988b service nova] Creating event network-vif-plugged:795d6dcc-3910-4da6-b102-5089193d5016 for instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd on hv-cinder-86022 Oct 06 04:47:55.879292 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-6751a4a3-1d1c-4a8d-b00b-6564ad4b8b36 req-7e2100fe-bed4-4a4b-8da0-0df73228988b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034557 Oct 06 04:47:55.879889 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 623/1252] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:47:56.667451 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:56.668065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:56.674476 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:56.674981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:56.675419 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:56.676112 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:56.676566 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:56.676991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:56.806439 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:56.814211 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-dd679c81-1dd6-4e63-a804-78f75a4db843 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.151276 Oct 06 04:47:56.814796 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 630/1253] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:56 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:57.839504 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:57.840226 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:57.847066 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:57.847717 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:57.848153 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:57.849042 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:57.849834 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:57.850577 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:57.991800 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:57.999875 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-05e01bb8-0d67-4b80-a809-0a7867c2745e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1571 microversion: 2.1 time: 0.166139 Oct 06 04:47:58.000432 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 624/1254] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:57 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:47:59.022883 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:47:59.023661 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:47:59.030193 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:59.030675 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:59.031136 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:59.031830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:47:59.032292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:47:59.032716 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:47:59.051209 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:47:59.165921 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:47:59.173655 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-fff3cfdd-8eab-4d09-bdd7-85fe1ee4d3c8 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1558 microversion: 2.1 time: 0.154658 Oct 06 04:47:59.174223 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 631/1255] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:47:59 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:34.197811 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:34.198380 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:34.200415 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:48:34.201072 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:48:34.207451 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:34.207945 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:34.208388 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:34.209089 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:34.209544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:34.210140 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:34.236381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Going to try to terminate instance {{(pid=127097) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:48:34.312366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-4ac0ef90-c950-447e-a154-8671934d02e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "DELETE /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 204 len: 0 microversion: 2.1 time: 0.118863 Oct 06 04:48:34.312951 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 625/1256] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:48:34 2022] DELETE /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:48:34.321179 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:34.321786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:34.324943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=30 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:48:34.325602 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:48:34.329648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:34.330104 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:34.330533 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:34.331259 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:34.331705 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:34.332123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:34.463673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:34.471435 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a9ad0038-53e5-4aa1-b561-d6039469b228 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1578 microversion: 2.1 time: 0.154013 Oct 06 04:48:34.472007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 632/1257] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:34 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:35.495062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:35.495905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:35.502332 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:35.502814 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:35.503284 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:35.503976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:35.504427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:35.504849 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:35.641157 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:35.649438 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-da82922e-e40f-4fa8-81e4-4125e430f3f2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1578 microversion: 2.1 time: 0.158705 Oct 06 04:48:35.649997 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 626/1258] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:35 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:36.673542 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:36.674185 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:36.682114 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:36.682603 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:36.683065 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:36.683798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:36.684251 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:36.684677 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:36.925070 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:36.933043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7f752e72-2a27-41e8-8b35-687b6d89e094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1578 microversion: 2.1 time: 0.263377 Oct 06 04:48:36.933626 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 633/1259] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:36 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1578 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:37.620033 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-f83ffc6c-75a0-498c-ba7a-14e3952f0d84 req-0194145c-0dfd-424b-9b49-55098f732a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645505a6-9888-4067-b2bf-3d9691760490", "name": "network-vif-deleted", "tag": "f12fd7b5-725b-4edc-bd05-d5f51d5449b7"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:48:37.630515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-f83ffc6c-75a0-498c-ba7a-14e3952f0d84 req-0194145c-0dfd-424b-9b49-55098f732a91 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:37.631135 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-f83ffc6c-75a0-498c-ba7a-14e3952f0d84 req-0194145c-0dfd-424b-9b49-55098f732a91 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:37.632154 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-f83ffc6c-75a0-498c-ba7a-14e3952f0d84 req-0194145c-0dfd-424b-9b49-55098f732a91 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:37.644881 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-f83ffc6c-75a0-498c-ba7a-14e3952f0d84 req-0194145c-0dfd-424b-9b49-55098f732a91 service nova] Creating event network-vif-deleted:f12fd7b5-725b-4edc-bd05-d5f51d5449b7 for instance 645505a6-9888-4067-b2bf-3d9691760490 on hv-cinder-86022 Oct 06 04:48:37.651176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-f83ffc6c-75a0-498c-ba7a-14e3952f0d84 req-0194145c-0dfd-424b-9b49-55098f732a91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034762 Oct 06 04:48:37.651957 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 627/1260] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:48:37.957169 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:37.957775 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:37.965060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:37.965691 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:37.966125 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:37.967044 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:37.967503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:37.967931 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:38.035105 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:38.043563 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-030da711-b6b1-4a31-820e-9bcc2d1a81dc tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 200 len: 1225 microversion: 2.1 time: 0.090127 Oct 06 04:48:38.044061 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 634/1261] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:37 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:39.068686 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:39.069424 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:39.075528 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:39.076020 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:39.076457 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:39.077160 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:39.077616 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:39.078043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:39.092000 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] HTTP exception thrown: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Request method failure captured: Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 HTTP/1.1 Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPl1p3Q35y1biapl8QY4oLp8cQoGiAmaG7o_TH8-kZDlC9OkSJGZwBfJSIUs1dYI9eoyHm-qDgTMMXj3ZxLXbLvuouyAvvRX4c2imO-bfcLltht1_gqxhCwKbTOx3IIwooH59k1HcUSkIfXVynwdCk-vqXVFJCuy7wMn0paQ1gVKGcho Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:48:39.093648 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 450dcd00d2404852b9635e72650d0c7f Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:48:39.095493 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '645505a6-9888-4067-b2bf-3d9691760490'} Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:48:39.096567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:48:39.098285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:48:39.099827 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Returning 404 to user: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:48:39.099827 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-60493b6e-e317-46de-8079-d71b905738bf tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 404 len: 111 microversion: 2.1 time: 0.031112 Oct 06 04:48:39.099827 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 628/1262] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:39 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:48:39.191816 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1746131878", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-794825599", "security_groups": [{"name": "tempest-secgroup-smoke-1871208602"}], "block_device_mapping_v2": [{"uuid": "b4853b3b-6781-447b-b412-6b66fc4cab7e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b5b78c7d-20eb-423c-ac79-d8c29b70489b"}]}} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:48:39.307424 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.network.neutron [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] validate_networks() for [('b5b78c7d-20eb-423c-ac79-d8c29b70489b', None, None, None, None, None)] {{(pid=127098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:48:39.673876 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Flavor limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:48:39.674295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Image limits 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:48:39.674763 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Flavor pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:48:39.675210 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Image pref 0:0:0 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:48:39.675617 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.virt.hardware [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:48:39.684500 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:39.684977 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:39.685405 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:39.686123 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:39.686569 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:39.687011 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:39.703121 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Getting quotas for project a707ca1042dd4fc99ff1dbd033efe0e8. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:48:39.707041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.quota [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Getting quotas for user 450dcd00d2404852b9635e72650d0c7f and project a707ca1042dd4fc99ff1dbd033efe0e8. Resources: {'ram', 'instances', 'cores'} {{(pid=127098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:48:39.764202 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Going to run 1 instances... {{(pid=127098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:48:39.766338 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4853b3b-6781-447b-b412-6b66fc4cab7e',volume_size=None,volume_type=None)] {{(pid=127098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:48:39.892971 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-18da9e26-5b25-4bb6-a8a1-b8e31e28be3c tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704933 Oct 06 04:48:39.893673 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 635/1263] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:48:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:48:39.906503 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6bbf59e3-3b38-4751-869f-8c96a93a0851 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:39.907148 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6bbf59e3-3b38-4751-869f-8c96a93a0851 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:39.962944 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6bbf59e3-3b38-4751-869f-8c96a93a0851 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:39.970221 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6bbf59e3-3b38-4751-869f-8c96a93a0851 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1094 microversion: 2.1 time: 0.067864 Oct 06 04:48:39.971057 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 629/1264] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:39 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:48:40.993763 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-69e069fd-675a-49b4-8bae-749507d64528 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:40.994375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-69e069fd-675a-49b4-8bae-749507d64528 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:41.046738 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-69e069fd-675a-49b4-8bae-749507d64528 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:41.054917 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-69e069fd-675a-49b4-8bae-749507d64528 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1094 microversion: 2.1 time: 0.066009 Oct 06 04:48:41.055511 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 636/1265] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:40 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:42.077452 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-e5c265e8-58a0-49d6-a1fa-eb5d3a6e340e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:42.078096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-e5c265e8-58a0-49d6-a1fa-eb5d3a6e340e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:42.136408 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-e5c265e8-58a0-49d6-a1fa-eb5d3a6e340e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:42.143535 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-e5c265e8-58a0-49d6-a1fa-eb5d3a6e340e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1094 microversion: 2.1 time: 0.069841 Oct 06 04:48:42.144099 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 630/1266] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:42 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:43.168573 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-d8674d1a-674e-46cb-a221-8c21b35f39d0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:43.169200 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-d8674d1a-674e-46cb-a221-8c21b35f39d0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:43.238199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-d8674d1a-674e-46cb-a221-8c21b35f39d0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:43.246290 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-d8674d1a-674e-46cb-a221-8c21b35f39d0 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1094 microversion: 2.1 time: 0.083246 Oct 06 04:48:43.246858 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 637/1267] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:43 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:44.269624 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:44.270237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:44.276794 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:44.277272 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:44.277707 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:44.278400 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:44.278852 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:44.279303 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:44.343391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:44.350986 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-f5dd80bd-11db-4aa2-b801-63ea6189ea46 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1144 microversion: 2.1 time: 0.085184 Oct 06 04:48:44.352295 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 631/1268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:44 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:45.375170 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:45.375739 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:45.382102 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:45.382666 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:45.383140 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:45.383845 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:45.384299 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:45.384729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:45.472635 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:45.481213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-62c98d62-95c4-4ed3-92e6-81ba7735d5a2 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1210 microversion: 2.1 time: 0.110347 Oct 06 04:48:45.481722 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 638/1269] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:45 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:46.479567 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-439f9abf-3c22-4424-b475-a377f457a834 req-8deadcd0-a948-4822-a1da-7802b1f5ebbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb743d3-a07d-435c-b719-54f51b883158", "tag": "056bfbf9-41d6-4d29-a4d1-5004af5c323b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:48:46.489298 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-439f9abf-3c22-4424-b475-a377f457a834 req-8deadcd0-a948-4822-a1da-7802b1f5ebbf service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:46.489781 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-439f9abf-3c22-4424-b475-a377f457a834 req-8deadcd0-a948-4822-a1da-7802b1f5ebbf service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:46.490247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-439f9abf-3c22-4424-b475-a377f457a834 req-8deadcd0-a948-4822-a1da-7802b1f5ebbf service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:46.504831 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-439f9abf-3c22-4424-b475-a377f457a834 req-8deadcd0-a948-4822-a1da-7802b1f5ebbf service nova] Creating event network-changed:056bfbf9-41d6-4d29-a4d1-5004af5c323b for instance bdb743d3-a07d-435c-b719-54f51b883158 on hv-cinder-86022 Oct 06 04:48:46.509630 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:46.510641 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-439f9abf-3c22-4424-b475-a377f457a834 req-8deadcd0-a948-4822-a1da-7802b1f5ebbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035485 Oct 06 04:48:46.510830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:46.511287 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 632/1270] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:48:46.518524 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:46.519069 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:46.519514 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:46.520230 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:46.520688 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:46.521109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:46.740798 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:46.748979 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3f0610c0-7d14-4163-af0f-fceec2de87a5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.247118 Oct 06 04:48:46.749548 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 639/1271] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:46 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:47.774669 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:47.775413 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:47.781614 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:47.782102 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:47.782545 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:47.783271 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:47.783732 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:47.784167 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:47.918726 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:47.926491 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1bf3d1ac-d9b7-4698-bd92-98c456f1e669 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.157173 Oct 06 04:48:47.927073 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 633/1272] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:47 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:48.950150 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:48.950755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:48.957170 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:48.957644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:48.958071 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:48.958755 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:48.959225 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:48.959648 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:49.091454 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:49.099078 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-028458f2-3c5d-431c-b43a-e0c47eb8fbc4 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.153086 Oct 06 04:48:49.099646 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 640/1273] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:48 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:50.123083 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:50.123669 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:50.130087 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:50.130574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:50.131032 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:50.131735 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:50.132192 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:50.133328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:50.263696 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:50.271351 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3f81913b-ff6e-4441-9a93-607bbc0e5132 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.152409 Oct 06 04:48:50.271916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 634/1274] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:50 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:51.294355 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:51.294975 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:51.296830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:48:51.303231 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:51.303718 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:51.304160 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:51.305444 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:51.305896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:51.306324 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:51.436615 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:51.444471 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-8982ad49-203c-4d34-bc61-082ec303390f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.153944 Oct 06 04:48:51.445743 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 641/1275] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:51 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:52.467933 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:52.468548 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:52.470939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=4 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:48:52.477010 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:52.477853 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:52.478588 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:52.479833 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:52.480577 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:52.481052 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:52.611041 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:52.618980 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-049a20b2-f12b-42cb-9d81-9eab591c89c5 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.154899 Oct 06 04:48:52.619553 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 635/1276] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:52 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:53.643583 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:53.644219 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:53.646670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=10 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:48:53.652213 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:53.652697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:53.653129 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:53.653821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:53.654274 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:53.654700 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:53.785461 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:53.793431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-717ef65e-e102-4734-8b16-a35a1b26f92d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.154271 Oct 06 04:48:53.794007 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 642/1277] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:53 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:54.816790 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:54.817347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:54.824288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:54.824773 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:54.825218 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:54.825910 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:54.826366 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:54.826791 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:54.954552 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:54.963053 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-2fb3c291-b987-4b5d-8be5-43c569ddb943 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.150210 Oct 06 04:48:54.963616 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 636/1278] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:54 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:55.986110 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:55.986636 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:55.993658 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:55.994139 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:55.994572 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:55.995295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:55.996002 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:55.996423 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:56.127805 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:56.135998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b31a195d-fe83-479b-a675-3f49ee8e4c0d tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.153880 Oct 06 04:48:56.136579 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 643/1279] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:55 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:56.169117 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-c17df537-127b-4a73-9800-af20836722b4 req-14a6f19d-8259-4df7-9935-53687238454d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb743d3-a07d-435c-b719-54f51b883158", "name": "network-vif-plugged", "status": "completed", "tag": "056bfbf9-41d6-4d29-a4d1-5004af5c323b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:48:56.179081 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c17df537-127b-4a73-9800-af20836722b4 req-14a6f19d-8259-4df7-9935-53687238454d service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:56.179640 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c17df537-127b-4a73-9800-af20836722b4 req-14a6f19d-8259-4df7-9935-53687238454d service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:56.180164 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c17df537-127b-4a73-9800-af20836722b4 req-14a6f19d-8259-4df7-9935-53687238454d service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:56.193163 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-c17df537-127b-4a73-9800-af20836722b4 req-14a6f19d-8259-4df7-9935-53687238454d service nova] Creating event network-vif-plugged:056bfbf9-41d6-4d29-a4d1-5004af5c323b for instance bdb743d3-a07d-435c-b719-54f51b883158 on hv-cinder-86022 Oct 06 04:48:56.198706 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-c17df537-127b-4a73-9800-af20836722b4 req-14a6f19d-8259-4df7-9935-53687238454d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033056 Oct 06 04:48:56.199462 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 637/1280] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:48:57.159601 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:57.160144 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:57.167253 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:57.167733 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:57.168195 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:57.168884 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:57.169336 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:57.169776 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:57.308288 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:57.315920 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-ac0da150-b005-4c8c-88f2-c5e929490ad6 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1266 microversion: 2.1 time: 0.160252 Oct 06 04:48:57.316490 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 644/1281] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:57 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:48:58.340148 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:58.340865 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:58.347471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:58.347952 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:58.348388 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:58.349099 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:58.349551 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:58.349974 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:58.483474 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:58.491096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-a67c79b2-29d4-4015-b528-af4910970285 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1453 microversion: 2.1 time: 0.155511 Oct 06 04:48:58.492285 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 638/1282] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:58 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:48:58.515630 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:48:58.516374 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:48:58.522743 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:58.523256 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:58.523846 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:58.524539 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:48:58.524986 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:48:58.525402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:48:58.657188 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:48:58.665466 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-a96e693d-cefa-47b7-ae41-1e9870bef9ec tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1453 microversion: 2.1 time: 0.154798 Oct 06 04:48:58.666047 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 645/1283] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:48:58 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:49:00.508088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-c5c18079-6d93-4ef9-ad1b-a901b367c1e7 req-d3f9e042-0b7a-4536-b523-4ac829192278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb743d3-a07d-435c-b719-54f51b883158", "tag": "056bfbf9-41d6-4d29-a4d1-5004af5c323b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:49:00.518195 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c5c18079-6d93-4ef9-ad1b-a901b367c1e7 req-d3f9e042-0b7a-4536-b523-4ac829192278 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:00.518677 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c5c18079-6d93-4ef9-ad1b-a901b367c1e7 req-d3f9e042-0b7a-4536-b523-4ac829192278 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:00.519209 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-c5c18079-6d93-4ef9-ad1b-a901b367c1e7 req-d3f9e042-0b7a-4536-b523-4ac829192278 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:00.531837 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-c5c18079-6d93-4ef9-ad1b-a901b367c1e7 req-d3f9e042-0b7a-4536-b523-4ac829192278 service nova] Creating event network-changed:056bfbf9-41d6-4d29-a4d1-5004af5c323b for instance bdb743d3-a07d-435c-b719-54f51b883158 on hv-cinder-86022 Oct 06 04:49:00.536730 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-c5c18079-6d93-4ef9-ad1b-a901b367c1e7 req-d3f9e042-0b7a-4536-b523-4ac829192278 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032416 Oct 06 04:49:00.537364 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 639/1284] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:49:28.689682 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:49:28.690233 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:49:28.693237 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:49:28.694601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:49:28.696590 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:49:28.697396 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=68 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:49:28.701251 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 04:49:28.701397 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Thu Oct 6 04:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd (ip 10.222.0.33) !!! Oct 06 04:49:28.703740 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:28.704228 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:28.704889 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:28.705375 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:28.705855 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:28.706246 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:28.737601 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:49:28.763015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-8a70c42d-a1cb-4fd1-b515-ddf16eaf4864 req-6b76fa8d-5d89-413e-b60a-39e5a83d101a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a05af87-4c0b-4f25-9c50-6d3cedb63acd", "tag": "795d6dcc-3910-4da6-b102-5089193d5016"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:49:28.772652 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8a70c42d-a1cb-4fd1-b515-ddf16eaf4864 req-6b76fa8d-5d89-413e-b60a-39e5a83d101a service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:28.773137 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8a70c42d-a1cb-4fd1-b515-ddf16eaf4864 req-6b76fa8d-5d89-413e-b60a-39e5a83d101a service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:28.773562 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-8a70c42d-a1cb-4fd1-b515-ddf16eaf4864 req-6b76fa8d-5d89-413e-b60a-39e5a83d101a service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:28.784782 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-8a70c42d-a1cb-4fd1-b515-ddf16eaf4864 req-6b76fa8d-5d89-413e-b60a-39e5a83d101a service nova] Creating event network-changed:795d6dcc-3910-4da6-b102-5089193d5016 for instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd on hv-cinder-86022 Oct 06 04:49:28.791252 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-8a70c42d-a1cb-4fd1-b515-ddf16eaf4864 req-6b76fa8d-5d89-413e-b60a-39e5a83d101a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103075 Oct 06 04:49:28.795151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 640/1285] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:49:28.824118 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-917723d8-cb18-43fd-a2ba-e98c30ce830e tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 204 len: 0 microversion: 2.1 time: 0.139093 Oct 06 04:49:28.824925 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 646/1286] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:49:28 2022] DELETE /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:49:28.834472 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:49:28.835465 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:49:28.843362 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:28.843860 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:28.844573 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:28.845394 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:28.845896 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:28.846387 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:28.987315 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:49:28.995969 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-6c701a68-40a1-4ae0-8082-25cd249dbe4a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.166488 Oct 06 04:49:28.996538 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 641/1287] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:49:28 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:49:30.020711 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:49:30.021457 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:49:30.029376 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:30.029859 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:30.030297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:30.031155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:30.031637 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:30.032060 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:30.203353 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:49:30.213762 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-f77b7707-0c86-40bc-b1c1-98aa31856f03 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1564 microversion: 2.1 time: 0.197113 Oct 06 04:49:30.217408 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 647/1288] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:49:30 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1564 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:49:31.232210 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-04bfb918-4860-4610-8e22-250b24375fef req-111cf844-e278-42b8-a211-fc3ce370d1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a05af87-4c0b-4f25-9c50-6d3cedb63acd", "name": "network-vif-deleted", "tag": "795d6dcc-3910-4da6-b102-5089193d5016"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:49:31.239458 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:49:31.240113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:49:31.243097 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-04bfb918-4860-4610-8e22-250b24375fef req-111cf844-e278-42b8-a211-fc3ce370d1b4 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:31.243714 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-04bfb918-4860-4610-8e22-250b24375fef req-111cf844-e278-42b8-a211-fc3ce370d1b4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:31.244149 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-04bfb918-4860-4610-8e22-250b24375fef req-111cf844-e278-42b8-a211-fc3ce370d1b4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:31.255829 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:31.256190 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-04bfb918-4860-4610-8e22-250b24375fef req-111cf844-e278-42b8-a211-fc3ce370d1b4 service nova] Creating event network-vif-deleted:795d6dcc-3910-4da6-b102-5089193d5016 for instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd on hv-cinder-86022 Oct 06 04:49:31.256631 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:31.257068 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:31.257852 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:31.258297 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:31.258723 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:31.262194 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-04bfb918-4860-4610-8e22-250b24375fef req-111cf844-e278-42b8-a211-fc3ce370d1b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033804 Oct 06 04:49:31.265862 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 642/1289] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:49:31.324034 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040bc65ba7f94c14999a98266ff0ce7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6698bc3af34041bd01a5d5abefb11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:49:31.331800 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3d3c5a90-48af-4d6a-a4ec-4a786814228a tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 200 len: 1217 microversion: 2.1 time: 0.096526 Oct 06 04:49:31.332371 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 648/1290] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:49:31 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:49:32.355629 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:49:32.356329 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] [instance: 3a05af87-4c0b-4f25-9c50-6d3cedb63acd] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:49:32.362870 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:32.363381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:32.363810 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:32.364495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:49:32.364944 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:49:32.365370 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:49:32.378540 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] HTTP exception thrown: Instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd could not be found. Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Request method failure captured: Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd HTTP/1.1 Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPl0AfgW9hKff7OBtjKUHWkCXHiY2JR0a9WHkkEOycg9aXAd4EvKWJaPhPM9l4XZurlOsNTs2WC-oZnpbT78hg-oG72jMgFmCLUy8G-XGZgtXLAdLUZbb03lUjGYolD9HSp5rLFpkVbFtLksfwEX1nnb8bIGMzW95DhUWTeZcrfxhX6I Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: 0a6698bc3af34041bd01a5d5abefb11c Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-TestShelveInstance-228057345 Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:49:32.380147 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a6698bc3af34041bd01a5d5abefb11c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a6698bc3af34041bd01a5d5abefb11c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a6698bc3af34041bd01a5d5abefb11c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a6698bc3af34041bd01a5d5abefb11c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-TestShelveInstance-228057345 Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: 0a6698bc3af34041bd01a5d5abefb11c Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-TestShelveInstance-228057345 Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-TestShelveInstance-228057345-project Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 040bc65ba7f94c14999a98266ff0ce7f Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-TestShelveInstance-228057345-project Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd could not be found. Oct 06 04:49:32.382807 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '3a05af87-4c0b-4f25-9c50-6d3cedb63acd'} Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd could not be found. Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:49:32.383932 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd could not be found. Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd could not be found. Oct 06 04:49:32.385733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:49:32.387277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Returning 404 to user: Instance 3a05af87-4c0b-4f25-9c50-6d3cedb63acd could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:49:32.387277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7ec163ca-5054-4b68-8d6d-04a7c1d54afb tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd" status: 404 len: 111 microversion: 2.1 time: 0.030643 Oct 06 04:49:32.387277 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 643/1291] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:49:32 2022] GET /compute/v2.1/servers/3a05af87-4c0b-4f25-9c50-6d3cedb63acd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:49:32.543773 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-c40d8b41-d7bc-4f18-8727-071f78699403 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] Calling method '.version_select at 0x7f0c42952f70>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:49:32.568853 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-c40d8b41-d7bc-4f18-8727-071f78699403 tempest-TestShelveInstance-228057345 tempest-TestShelveInstance-228057345-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-3162771" status: 202 len: 0 microversion: 2.1 time: 0.028285 Oct 06 04:49:32.570987 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 649/1292] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Oct 6 04:49:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-3162771 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 04:50:59.613043 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=8 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:50:59.613846 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=12 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:50:59.618391 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-692850004", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-794825599", "security_groups": [{"name": "tempest-secgroup-smoke-1871208602"}], "block_device_mapping_v2": [{"uuid": "3e22d156-3a70-4ec2-bef9-718956ac6e1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b5b78c7d-20eb-423c-ac79-d8c29b70489b"}]}} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:50:59.732051 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.network.neutron [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] validate_networks() for [('b5b78c7d-20eb-423c-ac79-d8c29b70489b', None, None, None, None, None)] {{(pid=127097) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 04:51:00.220442 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Flavor limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 04:51:00.220863 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Image limits 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 04:51:00.221336 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Flavor pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 04:51:00.221743 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Image pref 0:0:0 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 04:51:00.222151 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.virt.hardware [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 04:51:00.231591 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:00.232078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:00.232519 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:00.233248 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:00.233703 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:00.234128 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:00.250808 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Getting quotas for project a707ca1042dd4fc99ff1dbd033efe0e8. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 04:51:00.254782 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.quota [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Getting quotas for user 450dcd00d2404852b9635e72650d0c7f and project a707ca1042dd4fc99ff1dbd033efe0e8. Resources: {'ram', 'instances', 'cores'} {{(pid=127097) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 04:51:00.310851 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Going to run 1 instances... {{(pid=127097) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 04:51:00.313029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e22d156-3a70-4ec2-bef9-718956ac6e1a',volume_size=None,volume_type=None)] {{(pid=127097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 04:51:00.442533 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-1c9da555-86c4-412b-91d7-d23e8333a77b tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831171 Oct 06 04:51:00.443197 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 644/1293] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Oct 6 04:50:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 04:51:00.452737 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:51:00.453821 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:51:00.459463 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-da11c92b-6b91-4093-9465-5ead88fb9220 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:00.460430 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-da11c92b-6b91-4093-9465-5ead88fb9220 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:00.524291 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-da11c92b-6b91-4093-9465-5ead88fb9220 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:00.531646 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-da11c92b-6b91-4093-9465-5ead88fb9220 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1093 microversion: 2.1 time: 0.080658 Oct 06 04:51:00.532219 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 650/1294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:00 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:01.553912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:01.554474 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:01.562310 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:01.563441 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:01.563931 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:01.564803 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:01.565269 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:01.565694 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:01.632934 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:01.641601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-672dcdc6-82d9-465c-8443-6131190e4786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1191 microversion: 2.1 time: 0.091547 Oct 06 04:51:01.642463 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 645/1295] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:01 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:02.665981 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:02.666535 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:02.674656 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:02.675164 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:02.675600 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:02.676295 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:02.676745 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:02.677165 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:02.865159 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:02.873627 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b8603115-14fd-49e8-8037-3e071e19e897 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.211730 Oct 06 04:51:02.874294 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 651/1296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:02 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:03.146371 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-147d790c-6235-4809-9ea0-a508717a958b req-d4ddbb67-3ec2-4fa6-8990-edddf5b2f261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c7b042-d34d-41ac-960c-012b61c98a58", "tag": "889851cb-612f-44d5-85c4-152e91c1ef47"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:51:03.157223 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-147d790c-6235-4809-9ea0-a508717a958b req-d4ddbb67-3ec2-4fa6-8990-edddf5b2f261 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:03.157788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-147d790c-6235-4809-9ea0-a508717a958b req-d4ddbb67-3ec2-4fa6-8990-edddf5b2f261 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:03.158225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-147d790c-6235-4809-9ea0-a508717a958b req-d4ddbb67-3ec2-4fa6-8990-edddf5b2f261 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:03.169846 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-147d790c-6235-4809-9ea0-a508717a958b req-d4ddbb67-3ec2-4fa6-8990-edddf5b2f261 service nova] Creating event network-changed:889851cb-612f-44d5-85c4-152e91c1ef47 for instance b4c7b042-d34d-41ac-960c-012b61c98a58 on hv-cinder-86022 Oct 06 04:51:03.174901 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-147d790c-6235-4809-9ea0-a508717a958b req-d4ddbb67-3ec2-4fa6-8990-edddf5b2f261 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032310 Oct 06 04:51:03.175464 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 646/1297] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:51:03.896699 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:03.897313 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:03.904534 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:03.905066 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:03.905530 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:03.906224 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:03.906680 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:03.907134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:04.034153 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:04.042087 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-aa2761e1-27ff-434f-889f-6a6be5af98b7 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.149330 Oct 06 04:51:04.043393 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 652/1298] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:03 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:51:05.066668 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:05.067396 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:05.073495 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:05.074484 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:05.074977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:05.075674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:05.076129 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:05.076555 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:05.208770 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:05.216939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-54c55f0c-f542-485a-bcf3-75d804eaba81 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.155235 Oct 06 04:51:05.217514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 647/1299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:05 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:06.240176 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:06.240786 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:06.248037 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:06.248536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:06.248951 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:06.249637 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:06.250090 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:06.250511 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:06.379719 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:06.387988 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-3632c60b-d3f1-44d7-8373-6f858e42f094 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.151663 Oct 06 04:51:06.388553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 653/1300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:06 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:07.410848 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:07.411514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:07.417970 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:07.418448 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:07.418884 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:07.419606 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:07.420062 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:07.420485 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:07.550394 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:07.558015 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-dbd9fb74-3084-42e2-a6af-3d60c1a53269 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.150967 Oct 06 04:51:07.558571 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 648/1301] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:07 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:08.580038 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:08.580641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:08.586933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:08.587438 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:08.587869 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:08.588553 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:08.588998 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:08.589911 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:08.720893 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:08.728431 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-451c1849-d352-4559-98b1-f5449cbbac7a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.152271 Oct 06 04:51:08.729027 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 654/1302] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:08 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 04:51:09.752713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:09.753331 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:09.755788 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 04:51:09.755939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Thu Oct 6 04:51:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 (ip 10.222.0.33) !!! Oct 06 04:51:09.763811 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:09.764320 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:09.764778 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:09.765468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:09.765916 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:09.766335 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:09.898123 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:09.906381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-5f9432b1-5e1b-406a-9341-2b2ec1338677 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.157472 Oct 06 04:51:09.906977 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 649/1303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:09 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:10.929697 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:10.931134 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:10.935787 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell0:SELECT=2 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:51:10.939679 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:10.940157 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:10.940634 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:10.941305 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:10.941749 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:10.942167 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:11.073199 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:11.080943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-68a46198-e70c-473d-9941-eb363dd8aa5a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.155203 Oct 06 04:51:11.081508 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 655/1304] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:10 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:12.103365 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:12.103970 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:12.105998 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=2 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:51:12.106643 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell0:SELECT=6 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:51:12.112780 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:12.113259 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:12.113688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:12.114378 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:12.114828 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:12.115288 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:12.246946 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:12.254487 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-49770826-8417-42f0-a989-bb319108ac9f tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.155010 Oct 06 04:51:12.255060 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 650/1305] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:12 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:12.983706 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [req-88a7a139-a1d4-432b-bd09-c83a092f6b5a req-d4584430-2c1f-40d2-bb48-d636a96de3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c7b042-d34d-41ac-960c-012b61c98a58", "name": "network-vif-plugged", "status": "completed", "tag": "889851cb-612f-44d5-85c4-152e91c1ef47"}]} {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:51:12.993033 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-88a7a139-a1d4-432b-bd09-c83a092f6b5a req-d4584430-2c1f-40d2-bb48-d636a96de3a0 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:12.993538 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-88a7a139-a1d4-432b-bd09-c83a092f6b5a req-d4584430-2c1f-40d2-bb48-d636a96de3a0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:12.993964 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [req-88a7a139-a1d4-432b-bd09-c83a092f6b5a req-d4584430-2c1f-40d2-bb48-d636a96de3a0 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:13.004892 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.compute.server_external_events [req-88a7a139-a1d4-432b-bd09-c83a092f6b5a req-d4584430-2c1f-40d2-bb48-d636a96de3a0 service nova] Creating event network-vif-plugged:889851cb-612f-44d5-85c4-152e91c1ef47 for instance b4c7b042-d34d-41ac-960c-012b61c98a58 on hv-cinder-86022 Oct 06 04:51:13.009918 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [req-88a7a139-a1d4-432b-bd09-c83a092f6b5a req-d4584430-2c1f-40d2-bb48-d636a96de3a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147559 Oct 06 04:51:13.010495 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 656/1306] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:51:13.278229 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:13.278868 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:13.285449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:13.285930 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:13.286368 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:13.287091 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:13.287544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:13.287969 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:13.421544 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:13.429158 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-feb081f7-ff31-4f45-86f8-2f01fbba41da tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.155394 Oct 06 04:51:13.429712 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 651/1307] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:13 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:14.453595 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:14.454322 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:14.460451 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:14.460932 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:14.461366 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:14.462061 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:14.462513 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:14.462940 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:14.592111 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:14.599867 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-88276edc-f55e-456e-8a60-3c612eeb2f9a tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1265 microversion: 2.1 time: 0.151762 Oct 06 04:51:14.600440 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 657/1308] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:14 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:15.622549 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:15.623197 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:15.629667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:15.630159 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:15.630601 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:15.631328 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:15.631789 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:15.632220 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:15.760766 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:15.769145 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-9ceaaeb9-70af-4d69-b3c0-3b8d83b76801 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1452 microversion: 2.1 time: 0.151317 Oct 06 04:51:15.769713 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 652/1309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:15 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:15.791850 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:51:15.792512 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:51:15.798859 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:15.799374 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:15.799811 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:15.800504 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:15.800957 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:15.801378 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:15.931478 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:51:15.940040 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-23fc6209-9367-41fd-8fc1-2e0d61d0ed75 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1452 microversion: 2.1 time: 0.151985 Oct 06 04:51:15.940607 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 658/1310] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:51:15 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:51:17.784580 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-89e40e88-1f2b-4f3d-84e6-d644aacfe0fa req-71aafd62-5a0b-4a61-a059-a8d8efa767c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c7b042-d34d-41ac-960c-012b61c98a58", "tag": "889851cb-612f-44d5-85c4-152e91c1ef47"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:51:17.795059 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-89e40e88-1f2b-4f3d-84e6-d644aacfe0fa req-71aafd62-5a0b-4a61-a059-a8d8efa767c4 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:51:17.795615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-89e40e88-1f2b-4f3d-84e6-d644aacfe0fa req-71aafd62-5a0b-4a61-a059-a8d8efa767c4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:51:17.796111 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-89e40e88-1f2b-4f3d-84e6-d644aacfe0fa req-71aafd62-5a0b-4a61-a059-a8d8efa767c4 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:51:17.807131 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-89e40e88-1f2b-4f3d-84e6-d644aacfe0fa req-71aafd62-5a0b-4a61-a059-a8d8efa767c4 service nova] Creating event network-changed:889851cb-612f-44d5-85c4-152e91c1ef47 for instance b4c7b042-d34d-41ac-960c-012b61c98a58 on hv-cinder-86022 Oct 06 04:51:17.812555 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-89e40e88-1f2b-4f3d-84e6-d644aacfe0fa req-71aafd62-5a0b-4a61-a059-a8d8efa767c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031572 Oct 06 04:51:17.813410 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 653/1311] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:53:20.665329 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_api:SELECT=20 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:53:20.666348 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG dbcounter [-] [127098] Writing DB stats nova_cell1:SELECT=44 {{(pid=127098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:53:20.668021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 04:53:20.668560 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Thu Oct 6 04:53:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 (ip 10.222.0.33) !!! Oct 06 04:53:20.669241 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c020b71f-b6d4-48a1-8cac-376d5b6627ae] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 04:53:20.670449 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:53:20.671733 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG dbcounter [-] [127097] Writing DB stats nova_cell1:SELECT=48 {{(pid=127097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 04:53:20.673411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 06 04:53:20.679617 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-25f9f9da-e82b-48f6-b4bf-b059f7bbe093 req-5c588c1c-7858-476f-8af6-984cd8e3c2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c7b042-d34d-41ac-960c-012b61c98a58", "tag": "889851cb-612f-44d5-85c4-152e91c1ef47"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:53:20.681594 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:20.682370 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:20.693965 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:20.694460 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:20.694898 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:20.695653 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:20.695786 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-25f9f9da-e82b-48f6-b4bf-b059f7bbe093 req-5c588c1c-7858-476f-8af6-984cd8e3c2ff service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:20.696109 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:20.696239 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-25f9f9da-e82b-48f6-b4bf-b059f7bbe093 req-5c588c1c-7858-476f-8af6-984cd8e3c2ff service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:20.697160 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:20.697282 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-25f9f9da-e82b-48f6-b4bf-b059f7bbe093 req-5c588c1c-7858-476f-8af6-984cd8e3c2ff service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:20.708225 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-25f9f9da-e82b-48f6-b4bf-b059f7bbe093 req-5c588c1c-7858-476f-8af6-984cd8e3c2ff service nova] Creating event network-changed:889851cb-612f-44d5-85c4-152e91c1ef47 for instance b4c7b042-d34d-41ac-960c-012b61c98a58 on hv-cinder-86022 Oct 06 04:53:20.713347 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-25f9f9da-e82b-48f6-b4bf-b059f7bbe093 req-5c588c1c-7858-476f-8af6-984cd8e3c2ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046881 Oct 06 04:53:20.714156 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 654/1312] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:53:20.726879 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:53:20.817439 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-b8bde1ad-422e-4185-936e-7f8161f4a233 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 204 len: 0 microversion: 2.1 time: 0.153681 Oct 06 04:53:20.822310 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 659/1313] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:53:20 2022] DELETE /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:53:20.828825 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:20.829615 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:20.835612 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:20.836094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:20.836523 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:20.838088 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:20.838724 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:20.839191 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:21.088577 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:53:21.096841 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-3ad89b40-2ade-40b0-93f1-0006df152927 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1577 microversion: 2.1 time: 0.272368 Oct 06 04:53:21.097774 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 655/1314] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:20 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1577 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:53:22.122586 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:22.123318 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:22.130645 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:22.131154 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:22.131582 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:22.132275 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:22.132717 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:22.133131 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:22.332037 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:53:22.342983 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2914b9fc-2566-4af5-a08c-d5dbf166fc4e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1577 microversion: 2.1 time: 0.224941 Oct 06 04:53:22.343991 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 660/1315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:22 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:53:23.128019 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-19db82d7-5785-47ba-9e9e-23753eec79fd req-6f8de32c-7b6b-4584-8bdc-58175e561a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c7b042-d34d-41ac-960c-012b61c98a58", "name": "network-vif-deleted", "tag": "889851cb-612f-44d5-85c4-152e91c1ef47"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:53:23.139842 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-19db82d7-5785-47ba-9e9e-23753eec79fd req-6f8de32c-7b6b-4584-8bdc-58175e561a15 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:23.140247 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-19db82d7-5785-47ba-9e9e-23753eec79fd req-6f8de32c-7b6b-4584-8bdc-58175e561a15 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:23.140674 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-19db82d7-5785-47ba-9e9e-23753eec79fd req-6f8de32c-7b6b-4584-8bdc-58175e561a15 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:23.152688 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-19db82d7-5785-47ba-9e9e-23753eec79fd req-6f8de32c-7b6b-4584-8bdc-58175e561a15 service nova] Creating event network-vif-deleted:889851cb-612f-44d5-85c4-152e91c1ef47 for instance b4c7b042-d34d-41ac-960c-012b61c98a58 on hv-cinder-86022 Oct 06 04:53:23.156181 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO oslo.messaging._drivers.impl_rabbit [-] [c020b71f-b6d4-48a1-8cac-376d5b6627ae] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37102. Oct 06 04:53:23.157861 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-19db82d7-5785-47ba-9e9e-23753eec79fd req-6f8de32c-7b6b-4584-8bdc-58175e561a15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033534 Oct 06 04:53:23.158451 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 656/1316] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:53:23.367043 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:23.367647 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:23.374896 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:23.375402 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:23.375830 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:23.376514 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:23.376961 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:23.377379 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:23.440339 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:53:23.448330 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-7ebeed90-c646-4351-a3ce-1978b4fdaa32 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 200 len: 1224 microversion: 2.1 time: 0.085201 Oct 06 04:53:23.449113 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 661/1317] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:23 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:53:24.472411 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:24.473142 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: b4c7b042-d34d-41ac-960c-012b61c98a58] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:24.479468 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:24.479957 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:24.480397 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:24.481098 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:24.481586 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:24.482016 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:24.495581 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] HTTP exception thrown: Instance b4c7b042-d34d-41ac-960c-012b61c98a58 could not be found. Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Request method failure captured: Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 HTTP/1.1 Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPl1p3Q35y1biapl8QY4oLp8cQoGiAmaG7o_TH8-kZDlC9OkSJGZwBfJSIUs1dYI9eoyHm-qDgTMMXj3ZxLXbLvuouyAvvRX4c2imO-bfcLltht1_gqxhCwKbTOx3IIwooH59k1HcUSkIfXVynwdCk-vqXVFJCuy7wMn0paQ1gVKGcho Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:53:24.497427 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 450dcd00d2404852b9635e72650d0c7f Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance b4c7b042-d34d-41ac-960c-012b61c98a58 could not be found. Oct 06 04:53:24.499238 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'b4c7b042-d34d-41ac-960c-012b61c98a58'} Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c7b042-d34d-41ac-960c-012b61c98a58 could not be found. Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:53:24.500270 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c7b042-d34d-41ac-960c-012b61c98a58 could not be found. Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c7b042-d34d-41ac-960c-012b61c98a58 could not be found. Oct 06 04:53:24.501963 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:24.503506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Returning 404 to user: Instance b4c7b042-d34d-41ac-960c-012b61c98a58 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:53:24.503506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ac5e1077-8b26-4df8-9fbf-ab7839acee5e tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58" status: 404 len: 111 microversion: 2.1 time: 0.030939 Oct 06 04:53:24.503506 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 657/1318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:24 2022] GET /compute/v2.1/servers/b4c7b042-d34d-41ac-960c-012b61c98a58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:53:27.556655 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:27.559515 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-6909f67b-b309-424c-a062-54ceaf2a4388 req-d6d32463-4526-40c4-bb7a-57ad5f51d593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb743d3-a07d-435c-b719-54f51b883158", "tag": "056bfbf9-41d6-4d29-a4d1-5004af5c323b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:53:27.560034 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:27.567644 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:27.568433 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:27.568943 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:27.569078 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-6909f67b-b309-424c-a062-54ceaf2a4388 req-d6d32463-4526-40c4-bb7a-57ad5f51d593 service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:27.569489 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-6909f67b-b309-424c-a062-54ceaf2a4388 req-d6d32463-4526-40c4-bb7a-57ad5f51d593 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:27.569778 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:27.569915 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-6909f67b-b309-424c-a062-54ceaf2a4388 req-d6d32463-4526-40c4-bb7a-57ad5f51d593 service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:27.570361 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:27.570851 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:27.581795 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-6909f67b-b309-424c-a062-54ceaf2a4388 req-d6d32463-4526-40c4-bb7a-57ad5f51d593 service nova] Creating event network-changed:056bfbf9-41d6-4d29-a4d1-5004af5c323b for instance bdb743d3-a07d-435c-b719-54f51b883158 on hv-cinder-86022 Oct 06 04:53:27.587146 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-6909f67b-b309-424c-a062-54ceaf2a4388 req-d6d32463-4526-40c4-bb7a-57ad5f51d593 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Oct 06 04:53:27.587722 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 658/1319] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 04:53:27.597566 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Going to try to terminate instance {{(pid=127098) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 04:53:27.688155 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-baf47d33-f12b-47d3-90d8-f681ea68df24 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 204 len: 0 microversion: 2.1 time: 0.135816 Oct 06 04:53:27.689200 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 662/1320] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:53:27 2022] DELETE /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 04:53:27.699198 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:27.700026 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:27.706554 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:27.707174 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:27.708042 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:27.708840 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:27.709381 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:27.709905 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:27.846439 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.policy [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127097) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:53:27.855080 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-7eeea19a-2429-4671-a66c-7b004bcdd7a1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1577 microversion: 2.1 time: 0.161327 Oct 06 04:53:27.856029 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 659/1321] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:27 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:53:28.881822 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:28.882519 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:28.889661 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:28.890292 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:28.890729 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:28.891469 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:28.891979 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:28.892400 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:29.025269 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:53:29.033409 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-4c238003-df8b-451d-8998-0bdfbb186a29 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1577 microversion: 2.1 time: 0.155830 Oct 06 04:53:29.033978 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 663/1322] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:28 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:53:29.898409 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [req-84332722-6334-423b-b882-256f7dd4b4c1 req-bbf588fc-09fb-454c-a7c1-224952e5f02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb743d3-a07d-435c-b719-54f51b883158", "name": "network-vif-deleted", "tag": "056bfbf9-41d6-4d29-a4d1-5004af5c323b"}]} {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 04:53:29.909176 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-84332722-6334-423b-b882-256f7dd4b4c1 req-bbf588fc-09fb-454c-a7c1-224952e5f02c service nova] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:29.909667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-84332722-6334-423b-b882-256f7dd4b4c1 req-bbf588fc-09fb-454c-a7c1-224952e5f02c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:29.910096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [req-84332722-6334-423b-b882-256f7dd4b4c1 req-bbf588fc-09fb-454c-a7c1-224952e5f02c service nova] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:29.921574 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.compute.server_external_events [req-84332722-6334-423b-b882-256f7dd4b4c1 req-bbf588fc-09fb-454c-a7c1-224952e5f02c service nova] Creating event network-vif-deleted:056bfbf9-41d6-4d29-a4d1-5004af5c323b for instance bdb743d3-a07d-435c-b719-54f51b883158 on hv-cinder-86022 Oct 06 04:53:29.926923 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [req-84332722-6334-423b-b882-256f7dd4b4c1 req-bbf588fc-09fb-454c-a7c1-224952e5f02c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Oct 06 04:53:29.927961 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 660/1323] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Oct 6 04:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 04:53:30.058386 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:30.059021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:30.065316 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:30.065801 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:30.066237 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:30.066933 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:30.067411 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:30.067839 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:30.129264 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.policy [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450dcd00d2404852b9635e72650d0c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a707ca1042dd4fc99ff1dbd033efe0e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127098) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 04:53:30.137021 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-9599d075-5876-409b-b029-f37072278c02 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 200 len: 1225 microversion: 2.1 time: 0.083316 Oct 06 04:53:30.137593 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 664/1324] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:30 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 04:53:31.160514 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:31.161202 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: bdb743d3-a07d-435c-b719-54f51b883158] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:31.167430 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:31.167912 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:31.168373 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:31.169065 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:31.169516 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:31.169939 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:31.183479 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] HTTP exception thrown: Instance bdb743d3-a07d-435c-b719-54f51b883158 could not be found. Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Request method failure captured: Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 HTTP/1.1 Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPl1p3Q35y1biapl8QY4oLp8cQoGiAmaG7o_TH8-kZDlC9OkSJGZwBfJSIUs1dYI9eoyHm-qDgTMMXj3ZxLXbLvuouyAvvRX4c2imO-bfcLltht1_gqxhCwKbTOx3IIwooH59k1HcUSkIfXVynwdCk-vqXVFJCuy7wMn0paQ1gVKGcho Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:53:31.185071 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 450dcd00d2404852b9635e72650d0c7f Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance bdb743d3-a07d-435c-b719-54f51b883158 could not be found. Oct 06 04:53:31.186839 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': 'bdb743d3-a07d-435c-b719-54f51b883158'} Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb743d3-a07d-435c-b719-54f51b883158 could not be found. Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:53:31.187994 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb743d3-a07d-435c-b719-54f51b883158 could not be found. Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb743d3-a07d-435c-b719-54f51b883158 could not be found. Oct 06 04:53:31.189404 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.191096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Returning 404 to user: Instance bdb743d3-a07d-435c-b719-54f51b883158 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:53:31.191096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-ef4046aa-8e23-4004-999c-3abdb15c78e1 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158" status: 404 len: 111 microversion: 2.1 time: 0.030765 Oct 06 04:53:31.191096 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 661/1325] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:31 2022] GET /compute/v2.1/servers/bdb743d3-a07d-435c-b719-54f51b883158 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:53:31.625724 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:31.626255 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.compute.api [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127098) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:31.632536 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:31.633018 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:31.633452 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:31.634143 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:31.634597 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:31.635151 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG oslo_concurrency.lockutils [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:31.650503 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.wsgi [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] HTTP exception thrown: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Request method failure captured: Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: request: DELETE /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 HTTP/1.1 Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept: application/json Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Accept-Encoding: identity Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Connection: close Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Length: 0 Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Content-Type: application/json Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Host: 10.222.0.33 Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: Openstack-System-Scope: None Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: User-Agent: python-urllib3/1.26.12 Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Auth-Token: gAAAAABjPl1p3Q35y1biapl8QY4oLp8cQoGiAmaG7o_TH8-kZDlC9OkSJGZwBfJSIUs1dYI9eoyHm-qDgTMMXj3ZxLXbLvuouyAvvRX4c2imO-bfcLltht1_gqxhCwKbTOx3IIwooH59k1HcUSkIfXVynwdCk-vqXVFJCuy7wMn0paQ1gVKGcho Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Id: None Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Domain-Name: None Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Identity-Status: Confirmed Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Is-Admin-Project: True Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Id: default Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Domain-Name: Default Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Project-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Role: member,reader Oct 06 04:53:31.652741 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Roles: member,reader Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-Tenant-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Id: default Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Domain-Name: Default Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Id: 450dcd00d2404852b9635e72650d0c7f Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: X-User-Name: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: method: > Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: exception: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.654456 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: action_args: {'id': '645505a6-9888-4067-b2bf-3d9691760490'} Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:53:31.655432 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.657041 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.658753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Returning 404 to user: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. {{(pid=127098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:53:31.658753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-6e48c544-be35-4825-a619-f373c32cb845 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "DELETE /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 404 len: 111 microversion: 2.1 time: 0.032615 Oct 06 04:53:31.658753 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 665/1326] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Oct 6 04:53:31 2022] DELETE /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 04:53:31.663048 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '>' {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:31.663682 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.compute.api [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] [instance: 645505a6-9888-4067-b2bf-3d9691760490] Fetching instance by UUID {{(pid=127097) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 04:53:31.670049 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:31.670526 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:31.670976 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:31.671667 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Acquiring lock "1138271d-98fa-41e5-8be5-1f71544ce812" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 04:53:31.672115 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 04:53:31.672533 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG oslo_concurrency.lockutils [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Lock "1138271d-98fa-41e5-8be5-1f71544ce812" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 04:53:31.685471 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.wsgi [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] HTTP exception thrown: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Request method failure captured: Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: request: GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 HTTP/1.1 Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept: application/json Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Accept-Encoding: identity Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Connection: close Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Length: 0 Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Content-Type: application/json Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Host: 10.222.0.33 Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: Openstack-System-Scope: None Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: User-Agent: python-urllib3/1.26.12 Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Auth-Token: gAAAAABjPl1p3Q35y1biapl8QY4oLp8cQoGiAmaG7o_TH8-kZDlC9OkSJGZwBfJSIUs1dYI9eoyHm-qDgTMMXj3ZxLXbLvuouyAvvRX4c2imO-bfcLltht1_gqxhCwKbTOx3IIwooH59k1HcUSkIfXVynwdCk-vqXVFJCuy7wMn0paQ1gVKGcho Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Id: None Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Domain-Name: None Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Identity-Status: Confirmed Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Is-Admin-Project: True Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Id: default Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Domain-Name: Default Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Project-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Role: member,reader Oct 06 04:53:31.687044 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Roles: member,reader Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a707ca1042dd4fc99ff1dbd033efe0e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Id: a707ca1042dd4fc99ff1dbd033efe0e8 Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-Tenant-Name: tempest-TestVolumeBootPattern-1213704735 Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Id: default Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Domain-Name: Default Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Id: 450dcd00d2404852b9635e72650d0c7f Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: X-User-Name: tempest-TestVolumeBootPattern-1213704735-project Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: method: > Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: exception: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.689645 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: action_args: {'id': '645505a6-9888-4067-b2bf-3d9691760490'} Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: {{(pid=127097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 04:53:31.691094 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. Oct 06 04:53:31.693628 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: ERROR nova.api.openstack.wsgi Oct 06 04:53:31.696838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: DEBUG nova.api.openstack.wsgi [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Returning 404 to user: Instance 645505a6-9888-4067-b2bf-3d9691760490 could not be found. {{(pid=127097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 04:53:31.696838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: INFO nova.api.openstack.requestlog [None req-750441b4-51bd-4214-8a43-a433ffde8212 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490" status: 404 len: 111 microversion: 2.1 time: 0.029260 Oct 06 04:53:31.696838 dv-cinder-860227-2-iscsi devstack@n-api.service[127097]: [pid: 127097|app: 0|req: 662/1327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Oct 6 04:53:31 2022] GET /compute/v2.1/servers/645505a6-9888-4067-b2bf-3d9691760490 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 04:53:32.986641 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: DEBUG nova.api.openstack.wsgi [None req-2e038cf0-8e29-403f-a099-eea4cc30b786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] Calling method '.version_select at 0x7f0c4294b5e0>' {{(pid=127098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 04:53:33.019670 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: INFO nova.api.openstack.requestlog [None req-2e038cf0-8e29-403f-a099-eea4cc30b786 tempest-TestVolumeBootPattern-1213704735 tempest-TestVolumeBootPattern-1213704735-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-794825599" status: 202 len: 0 microversion: 2.1 time: 0.037317 Oct 06 04:53:33.020555 dv-cinder-860227-2-iscsi devstack@n-api.service[127098]: [pid: 127098|app: 0|req: 666/1328] 10.222.0.33 () {58 vars in 1260 bytes} [Thu Oct 6 04:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-794825599 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)